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"Ggislation Relieve that the principle ©jf fairness outweighs 
technical objections to opin testing. Opponents feel that " supporters 
of the legislation should shoulder the"*- burden, Of .proof that/the law 
is necessary. Issues related to the testing 'controversy inciludei the 
role and power of American testing organ^izatlons; the natin^e, 
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J^REFACE 



At the August 1979 annual meeting of the Education CommissiQn of thp.. 
States, a resolution was passed directing the staff . . to undertake a^study of 
the intent and implicatiogs of recent state actions and legislation pending iri 
Oopgress to open the testing process to public scrutiny." With the assistance of 
a sn^^all grant from the Ford Poundation/the study was initiated in Octo^^er , 
'under the directibn of the Department of Postsecondary Education. The, 
authors reviewed positions of the proponents and opponents of legislation, the 
content of existing and proposed state and federal legislation and anatysis o,f 
.the .legal and other isSUes raised by the laws. Copies of the draft report were 
distributed to some 40 revifewers^ including the majqr representatives of both 
sides of tHe issues. Their comments and suggestions have been incorporated in 
this final draft. * ' - . 

' 0 ' ' • ■ ■ 

We are grateful to the National Assessment of Eyucatioiial Progress (NAEPj^for 
the loan of Rexford Brown, NA^P Director of Publications and User Products, 
who served as primary author and editor fof the report. Merle Steven McClung, 
Director of the f CS Law and Education Center, piovided the legal analysis of 
the hnplications of the enacted and proposed legwalion. 

, - 

kict)ard M. Millard 
\^ . ; Director, Departmerit of 

Postsecondary Educatior) 
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EXECUTIVE SUMMARY 



This report, prepared by the Education Compiission of the States, sketches the* 
Jbackground out of wrhich **truth in testing" legislation arose, describes existing 
state and federal testing legislation, details' arguments jaised ih hearings on the 
legislation, analyzes the legal issues^ raised by the legislation and pifovides a^ 
framework for simplifying the ^guments and 'gathering more information- 
*^ about important contentions. The report is not a policy ^atemeht; rather, it is 
mte^ided to provide ^nough background to prepare legislators confronting the 
issue for the major .points they oan Expect to see raised in' discussions and 
hearings. , ' * ^ . ^\ 

At the center of the debate are two definitions of ^^fairne^f On one side are 
the proponerjjte of disclosure legislation, who argue that a»^ matter of sirltple 
fairness students should be able to see ftie* test instrument (including the 
questions, the answers and related .test data) used to make imjjortant decisions 
about their lives. Proponents feel that te^ts are social policy instrupients that 
should, in a democratic sdciety, be dpen to scrutiny. On the other side, the 
opponfnts pf legislation argue that test security insures fairness, so disclosure 
of the tests will, by breaching security , 'affect the validity of thQ tests, increase 
M^tosts and lessen confidence in standardized tests, all of which will erode 
fairness ^decisions made about students. They feel that secure standardize<} 
tests give everyone an equal, chance and are more democratic instruments for 
policy making than are alternatives that permit the intrusion of various^ases. 

Proponents of the legislation believe that th^ principle of fairness out>yeighs 
technical objectiotisr to open testing. They believe that security is hot essential 
for test validity and that the burden of pVoof rests upon the test companies- 
Specifically, they ask that the test compgenies prove their allegations that full 
disclosure will weaken test validity, increase development costs, exhauafthe 
oumber of test questions that can be asked, erode confidence in tests and lead 
to a climate of more uAfairness in decisions th^it^nvolve test scores. . 

0{SWi€fnts of the legislation believe tha^t the burden of proof that a law is, 
''necess^y rests upon the supporters of testing leg^fation. Specifically, they ask 
for proof that-a substantial problem with test use or abuse exists,' that the 
legislation will correct any misuses and abuses, that open testing is technically 
feasible and that substantial benefits accrue to individuals and society through 
test disclosure that are not offset by government intrusion^ and, potential 
damage to standardized testing and admissions procedures. 

Th^se two public interests must be% balanced against one another. l/t addition, 

circling around them are a host of related issues (summarized in Exhibit 1, page 

xi). There are arguments about the role and power of American testing 

companies. There are arguments abo^ the nature, quality, use arid misuse of 

^standardized tests in general and te^^sed for admissions decisions. T^ere are 

arguments about the consequences of government intierference in this area. The 

debate wiy continue as state bills are considered and the federal leg.}slation 

surfaces again in the 1980 Congressional session. New Maws, compromises, 

amendments to laws and court decisions will clarify the situation in coming 

months. There is no reason to discourage states from considering;this issue, but 

there is every reason to encourage them to do so comprehensively, listening 

carefully to both sides arid watching developments in New York and elsewhere. 

♦» 
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INTRODUCTION . , 

► ■ ^ .. - 

The following repfbrt attempts to clarify injportant pQsitionS^ tgken for oi*- . 
against legislation aimed at standardized tests. It begins by placing the **truth in 
testing" issue in its social and historical cpntext. Then it examines the testing 
legislation itself antj its legal and practical implications for sucjji important 
grojups as educators, ^test developers, admissions officers and, of coUrse, the 
.millions of students and adultSnwho are tested every day in America. Before 
launching into the debate, however, we should be clear about the particulars of 
the legislation at the heart of thte ccMitroversy. The first law requiring test 
publishers to disclose information to test takers and the public was California's 
SB t2Q05, enacted in September 1978. The law applies to any standardized test ' 
used 'f6r postsecondary education admissions selection and given to more than 
3,000 students — in other words, such tests as the Schblastic Aptitude Test 
(SAT) ^ut9 the Ameirican College Testing (ACT) Assessment- The law requires 
that a test's sponsor must file with the California Pos^econdarj^ Education 
Comrnission various kinds of data describing the 'test's features, limitations and 
use; must provide test takers with various kinds of information about^a test and 
how it will be used; and must submit data about the>^administration of the test, 
the income "realized and 'the e^enses incurred in its administration. 

A second state law was enacted Tn New York iri 1979. Like the California law, 
it applies only to tests used for postsecondary or professional schtool* admissions 
and requires test publishers to file background Reports about their tests and 
jprovid'e test takers with .ample information. In addition, the ^Jew York law 
requires the test agencies to file the contents of the tests with th^ New York 
Commissioner of Education within 30 days of release of scores, and, thereafter, 
provide thenr to test takers upon request. Further detail abpnt these ^.laws 
appears in Table 1, pg. 17, later in this report. ^ ] 

In addition to these la>ys, similar bills — some requiring total disclosui^e of the 
test (such a5 the New York bill stipulates), some not — have been filed in 
Florida, Maryland,. Ohio, Texas,_Colorado, Massachusetts, Pennsylvania and 
New Jersey (Table 2), pg. 19, although none has yet been enacted. Other state 
bills Appear to be imrtiinent. Two federal bills also were 'introduced in 1979 — 
the 'Truth in Testing Act of 1979,'' known as the Gibbons Bill or H.R. 3564, 
and the "Educational Testing Act of 11^79," known as the Weiss Bill, pr H.R. 
4949. The fdrme? covers achievement and occupational tests as well as 
admissions tests; but does not require total disclosure; the latter is limited to 
admissions t^sts but does require total disclosure, as well as a number of other 
requirements.' These bills are detailed in Table 3, pg. 25. 

> 

All but two of the bills - introduced* ;apply to * postsecopicjary eHucation 
admissions testing only not to standardized achievement tests In areas such as 
reading and history; personality or diagnostic tests; or minimal competency 
exams (although Massachusetts requires total disclosure of its competency 
tests). With the exception of the Gibbons Bill,, they do not apply to 
occupational testing, civil service or licensing examinations. The New Jersey bill 
applies^ to alf tests **developed by a lest agency for the purpose of selection, 
placement, classification, graduation or any other bonafide reasori concerning 
pufxils in elementary and secondary ,j)ostsecondary or professional schools.'*' 

The arguments about testing legislation seem to fall into four related but 
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distinct groups. The first, m^or dus«er of -irrmifnts rmtPTs around the rol(* 
and pbwer of, .the tegting industry; the .s% %i Jt>nters • oun.i the naWiro 
and quality of standaVdized teatsj^'the ihir-a concerns hhe, need foi* state or 
federal legisl»^tion in this area and th* problems with existi*»B tr^p'oposof' 
legislation; and^e fourt,h — really a suhdivii^on of the third, but Substantial 
enough to merit 'Bepairat*^ creatment - 'innters around . the /onsequeajces of the 
full disclosure {Mrovisiocis specified in several of liie proposed and enqjited kws. 
These arguments are summarized" in Exhibit 1 at thexend of thisi4i^trodu6tibH^. 

Within each grou i of coneys strong, polarized positions tend to dpmirvate. 
For instan-ce, on(» is asked to believe that, testing companies, ilre too poMverful 
and that, they are not particularly powerful at all; that standardiized i tests are 
wors^ than the^'subflective" measures they were supposed to replac^anc^ ttiat 
they are far superior to old, biased ways of evaKiatin^ people; or that- total 
disclosure of test materials wiU either injpijove or destroy standardized tests. 
Where the clash is most dramatic -ip the confliiit over disclosure - both si^es 
ironically appeal to the'same priiiciple - "fairness." When the major groups of 
.arguments are examined it beCojnes obvious that the antagonists ajre seldom 
drgi^ng^upon the same facts, looking. at the sarhe aspects Of the educational 
enEerpris^ or subscribing to the s^me l»eliefs about thfe nature and function of 
education. They are moje oflen arguing at each other thamwith each other". 

Many people wjithln the testyig community favpr the proposal to m'ake more 
information about ' testing available. Many people who dislike massive testing- 
nevertheless oppose government interference or regulation, these bills ^r 
aspects of these bills. ]Even some of the draf«rs of the bills and laws plan to 
change specific sections. MuCh of the technical criticism of tests comes from 
within the psychometric fcommunity itself. Some people who dislike testing are 
against the legislation because they' feel .it will only further legitijnize it and 
increase profits. The moralis clear: any summary such as this one will create an 
illusion of distinct camps, each of which subscribes to everything attributed to 
either "proponents" or "opponents" of the legislation. This is not the case. 
Any particular argument for or against tests or the legislation is lively to be- 
supported by some people one would expect to be on "the other, side." The 
following exhibit is intended to put into a nutshell the major arguments that 
have been advanced for and against testing legi.<?lation. 

^ Although there is a certain logic U\ the way the report is organized, some 
readers may well want to skip to thoserparts that interest them most and return 
to other parts at their leisure. EacH-issue listed in the exhibit is discussed in the 
'repjort and nan be pursued further through the publications listed iw^e 
Bibliography. ) 
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Exhibit 1/ The Debate About Testing Legislation in aiylutshell 



< 



I. Debate ^bout Role and Power of Testing Companies 



^ ^ Antitesting Sentiments 

Tests have profound influence upon American lives and 
life chances. 



testing companies are una^ountable to their dependent 
^public— -particularly true of the Educational Testing 
Service (ETS) and American College Testing (ACT). 



Te|ting companies kre too secretive; test fifcrs db not 
know enough about tests; researchers c^^t study 
them. 



(St fl^ r 

f 



Massive testing does more harm than-good (e.g., 
consumes time better »pent learning, alters curriculum, 
stigmatizes children, misleads public, etc.). 



Tests are inherently biased agamst plurdli$m, tend 
further stratify society. • , 



PrO'Te>tinfl.Sentit<Tients 



Tests have little fftfluence compared to family, social and 
educational influences, grac^e point average. 

Commercial test publishers are accountable t8 market 
forces; test makers, including ET3 and ACT, are ^ 
accountable to professional standards, education*. 
^'Community, higher educa^tion communities, courts^ 
client groups, trustees and Internal Revenue Service. 

Critics confuse security - a technical issue — with 
sebrecy; ample test information is available both to test 
takers and qualified researchers. 

The public and higher education have asked for massive 
testing;,testing produces informptipn useful^for ' 
improving edi^ation; it does more'good than harm (e.g., 
takes little time>diagnoses problems^ helps 
administrators, etc.). 

*• 

Thelcuiture is inherently biased; bias in tests is being 
minimized; don't blame the messenger; testing helps 
minorities. 



^ Tests are widely riisu§ed and misunderstood. 



Test companies'try hard to curb abuse ,.educate users. 



II. Debate About Quality of Standardized Machine-Scored Tests Used Primarily for Prediction 



Critics of Standardized Tests 

Tests concentrate on easily measured cognitive skill's, 
ignoring higher leveL^kills (e.g problem solving), 
imagination, creativity, etc. 

) 

Theory upon which testing rests is sirpplistic, outdated 
and sketchy. 



Defenders of Standardizejl Tests 

Society values intellectual achievement, cognitive skills; 
education (especially higher education) stresses those 
skills; others (e.g., teachers) are better able to assess 
'magination, creativity* etc. 

Theory Jpon which education rests may be simplist^ 
outdated and sketchy; test theory i? better than 9ritics 
think and always improving. 



Test information j§ much less precise than testers 
pretend. 

Tests^are seldom valid even by test makefs'^tandards. 



Tesftare developed suljjectively and always contai 
cont)t)versiaI items, • 



Test scores-do not predict success in later life 



^ptrmaT qualities of multiple-choice tests mnvey » 
messages tl^at undercut-reasoning skills, writing ability, 
accurate perception of the world. 



Test infcy'mation is improving in precision and !s better* 
than massive subjectivity. 

Many tests are rigorously validated and most do wh^t 
they are designed to do. 

> 

Tests are devel^ed by educators and scholars, some of 
whom always disagree with others; in the main, they do 
what they are supposed to dp. 

Test scores accurately pr>^cnct such things as academic 
success in first year of college, first \/em of medical or 
law school, etc.; they are not^designed to predict success 
in later life. 

No empirical data are offered to support such fears; 
testing consumes too little of a student's time to have 
such effects. 
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Exhibit 1. TKe Debate About Testing Legislation in a Nutshell (cont.) 

ML Debate About Need for Testing Legislation 



• Pro> Legislation Sentiments 

Qfade inflation, misuse have combined to give tests too 
much ipfluence in admissions decisions. 

A commitment to "truth in lending," "truth in 
advertising," sunshine laws and consumerism shou|d 
.extend to an area as important as admissions testing. 

Because admissions tests have suef> influence, there is an 
overridi/ig public interest at stake. 

Legi^ation will promote greater accuracy, validity of 
tests. 

Legislation will encourage use of multiple criteria in * 
selection process. 

The adiViissions test industry is not accountable to 
anyone. 



Antilegislatton Sentiments 

High4f education's need for students has lessened'* 
importance of admissions test scores. 

Test publishers and higher education .institutions already 
provide ample information and protection; analogies to 
^ consumer movements are misleading. 

Jhere are several competing public Interests at stake; 
critics have not established an^overriding^need for 
legislation. * 

Legislation callirtti for full disclosure will lower the 
quality of tests* 

y Most institutions already use multiple criteria and test 
agencies encourage the practice. » 

The industry is accountable to tfje psychometric 

profession, market forces, academic community. 

t 

federal legisJation would constitute dangerous, if not 
unconstitutional, federal incursjon into education. 

^ e 

^ - Legislation interferes with First Amendment right of 

' * v*^ colleges to determine who they want to teach. 

IV. Debate About Full Disclosure 9nd Other Aspects of Legislation ^ 
Arguments Against Full Disclosure 

Students cannot learn much from examining their test items. • ' • * 

Teachers may try to increase aptitude test scores by teaching the test ^items, thus damaging curriculum."^ . . 
Full disclosure will compromise test security; compromised security means less confidence in tests. 
Release of items will Jead to invalid interpretations and nr\isunderstandings. 
Accumulation of disclosures over the years will erode test quality and utility. 

Good iter^are the result of a costly, technical and professional process; they should be husbanded to have long life. 
Sample tests are sufficient. * _ ^ 

It makes more sense to disclose a full specimen ot the tes.t before the test taking session, so test taker knows what to 
expect. 

Disclosure^Will remove economic competitive incentive to create nevy and better tests. 

If admissions officers lose confidence in test scores, disadvantaged students will suffer. 

Disclosure mJans fewer test administrations per year in order to keep ^ test secure as long as possible. 

Disclosure will increase test development costs, thus the cost of tests to'students; pporer students will suffer. \ 

.Disclosure will decrease amount i?f time available for development, leading to greater possibility of biased 4tems creeping 
• into t^sts. 

Disclosure will benefit expensive coaching schools, further hurting poor students. 
Disclosi^W makes comparability measurement more difficult. 

Disclosure requirement constitutes seizure of private property without due process and in violation ef proprietary rights 
^protected by copyright laws. , ^. V 
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Exhibit 1. Th« Debate About Testing ^.egislation in a Nutshell (cont.) - ^ 

* \ « / , ■ ■ 

IV. Debate About Full Disclosure and Other Aspects of Legislation (cont^T 
Counter Arguments About Full Disclosure 

_ y Students can learn about tests and test strategy from examjning test questions. ' ^ 

Security need not be an issue; new measurement technology could enable testers to eliminate the problem. V 
Development costs would not increase as much as testers suggest. 

Items now availably only to expensive coaching schools would be available to everyone, benefiting poor students. 
There are many solutions to the comparability problem; the law,s do not adversely affect comparabiMty measurement 
The fairness issue takes precedence over technical matters. 

Disclosure will help admissions officers as well as students. ' • 

Arguments Against Rele^e of All Studies, Evaluations or Statistical Reports Pertaining to a Test 

(para. 341, New York; Sec. 4(a)(1)(A), Weiss Bill) ^ ^ ' * 

^ These provisions'may interfere with academic ^nd institutional freedofn in violation of the FirsV Amendment of the U'.S. 
ConstitKllOn. / J ' ' " . ^ 



/ 



ERIC 



XUl 



1 O 



' I BAGKQROUND 

Arn^ripa's^ schools serve many functions. They play a major role in socializing/ 
our children, teaming them explicitly and irr%plicitly*wfiatj& expected of them 
as citizens. They setve as' thie -locus for acculturation, integrating children from 
raany diffeyent backgrgunds. They offer a wt^ie range of courses, ^ervic^s and 
exjperiences designed tp eijcourage* fulf personal ^development. They figure 
heavily in courtship aqd matg sdfeotion. TfieJ^ bjnd neighborhoods and 
communities.' And they traip children in the tec^tiTiTcal ski]ts*jbhey will need to 
fit e^ly into. the wbrk.worlji that lies*.beyond .formal sohpjjrting. With this. last * 
functi^)n, the pireparationr of futute workjers, comes th^ schools' rple in^ 
^certifying, identifying for- the woHd outmde th^e school iodividuals Svhp have 
'certain rQarketable skills or are likely to make' parti<5ular contr'ibutidils to 
society. Certification often requires testing of some kind. ' ■ 

• . ' . I 

Plilblic interest in the'schools tJfcids to focus on oi^ ottwo of4lxese ianctions at 

a time and groups of people tend to value some the furl^ons over oth^ers^ 
depending on q variety of social ifactors. Consequently, there are many people 
for whom tiid paramount function of schools is to educate:each individual child 
to his or^her full potential, and there are many for vvhom^the 'f|'aramo\int ^ 
function is simply .to4rain children to work in the existing w'ork^wdrld. The 
former might ^question the wisdom of a three . R's curriculunii, and the latter 
might questibn( the utility of many elective cog^ses. The former might 
dominate educational policy during. a ** progressive'' era, and the latter mig'ht 
dominate during a **back to basics" era. , • 

America has seen metny progressive and many basic eras^ as well as ^ras that 
have been dominated by concern for the sorting, supervisory and accjulturative 
functions. All of them seem tied to such noneducational matters as the nation's 
economic health, wars, large shifts in the kinds of^work available in the scyiety,* 
large influences of immigrants, baby booms orxivil rights 'movements/ 



. . . However laudable its intentions, the New Yorf^Jam capnot 
force Jest^ companies to explain the meaning of test scores to 
students: and certainly this law cannot deal with the complex 
issues of test validity and^j^ role of cultural factors iti influenc- 
ing test results. The consimction, evaluation and interpretation 
of tests are highly technical matters which must be dealt with 
by ongoing ^f^drch by those who are trained in this specialty. 
The important problem of the use anc^buse hf standardized 
tests cannot be resolved by a simplistic law which confu^g^this 
issue with consumer protection problems. * 



Kenneth B. Clark, Social Psychologist * 
Member, New York Board of Regents, 
The New York Times, August 18, 1979^ 
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Accountability a 
Gi^rrept ^ocml 
Theme 



Are Schools 
Accountable? ^ 



■i 



■ \ 

Proliferation of 
Test Use 



^-^esttng and 
« Education Both 
Under^'^ire 



[ 



Our present po8t;-Vietr!iun* and Watergate era is marked 'by a vfridespiiead 
reappraisal pf Amefican. institutions. There, is disiUusionnient ^witlTlthe 
American military, tKe' federal government, the Presidency, the FBI, the CIA, 
the oil companies, the pfess; the courts, nuclear energy — the list goes on and 

* on. And irj all of lihe criticism^ of our institutions, one is persistent enough to 
roughly sum up Jihe era's theme: ouV'jhstitutions are accused of not being 
sufficiently accountable to the people who support them and whose lives ar^^ 
affected, sbmet^ea' profoundly, by their action^. Our educa^onal system has 

* not escaped thiTs deiire to demystify fcistitutibns and regain control ovpr them, 
^ It, •^o^ ip being a^ked to account for its ways. *AlthQU^ th^ pressure, for 

' accountability has touched all of the 'many functions of our s<ihools, itThas 
(perhaps bec&ush* 'of ^the state the*jecohomy) focused mainly on the 
traitiing/Cfertifying- functions. The schools' are suspected of not produqing a 
work fof^ce sufficiently c6fnpetent to m^et our cofnpl^x social and technologi- 
cal needs. vThe burden of, proof that they are pt are not has* shifted back and 
forth, but( tke proof itself hafi depended heavily on standardized test scores. 
With- more w6ight beijag placed on standardized test scores as indicators of 
» educational qiiality, it y^^as only natural that the tests thprn^elves would cqm? 
under increg^ing scrutin;5i. Charges of misuse, bias against minority groups and . 
cavalier treatment of test subjects have proliferated* as test use has proliferated. 
Add the* fact that testing is an enterprise of sufficient magnitude to falljDrey to 
the national skepticism;''add the fact thajj^ tests have become an irjtegrffl part <>f 
the infrasti;iicture upon which the ideal of an American meritocracy rests; and 
add the fact tha^ the ideal of a meritocracy itself is under attack — and it is not 
sCftprising either that this ifssue has surfaced again or fhat it generates vigorous 
/and confusing debate. * / . „ - \ 

This is^not the first time the testing community has been examined, of ^course. 
Jhere is an extensive critical literature about testing that goes back, a half^ 
century. M?iny of the antagonists at the recent legislative hearings on this issue 
have crossed swoKjis for decades, Banesh Hoffman's The "Eyrannyof Testing, a 
classic critique of the industry, "was pul3lished in ^^6aL the Russell Sage 
/^^oun^^ion "Studies of tests and their implications were con^ucted Tn'the mid- 
sixties; |aid**the Commission on Tests, convened by the College Entrance 
Examination Board to study its activities, published iCs findings in tK^^arly , ' 
seventies. Many other studies have been conducted during this decade,* and the 
relational Acadeiny of S^cience i§ currently investigating the issue. However, this--- 
is the first time a la\y such as New York's ^Admi^sion Testing Law hjwi^actually 
be6n enacted, and as the issue surfaces this time, it finds itself in the age oL^ 
sunshine laws and consumer protection legislation. It is an old issue' in 3 new 
context. • . ^ * . 



Conflictinf^ Views 
of Testing 



A brief report such as thi» one could never dcf justice to the interesting history 
of testing iin America or to the Complex role that it has come to play in our 
lives. However, a short survey of conflicting views about testing is necessary 
because they undergird arguments for and against testing legislation. Many 
p^ple support or djslike the legislation solely on the^strength of their feelings 
about test companies and irrespective of any facts that might be introduced on 
one side^f the other. 



Criticisms: 
Testing Agenciep 
Too Powerful 
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A. DEBAT^ ABOUT TESTING. COMPANIES AND THEIR INFLUENCE 

Crit^s of American testing agencies as«;ert that thej^ have enormous collective ^ 
power and influence. They claim that over 40 million > elementary ancr 



♦See VII: Bihlion^phy, pn^e 54, 
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secondary students take more than 200 million tests ^every year at a cost of 
more than»a quarter of a billion dollars. Entrance'into higher educatioij arid a, 
multitude; of pccupations depends heavily, the critics maintain j'llpon stjandard- 
ized test Scores. In spite of their critical role in d^rmining who gets ahj&ad in 
America, many of the* agencies a^'e accovin table jfe Virtually no' one. They' 
appear to thei^ critics to create thefr own lucrative markets and operate l^gely 
in secret, ignoring criticism and ci^tivating a coterie psychometricians ^d 
researchers who both sanction arid further mystify their ^u^tivi ties/ 



We allQcate' scarce ^education and work*opportunkti^s'iaifh apth 
tude tests. Few people understand tfiese te^ts. Test developers 
and users do not^orovide information needed for us to undeh 
stand. Yet we do not hold this industry accountqble ,for their 
secretive probing of our minds. Current testing practices are 
harmful to this country's goals of equity and a competent wo^k 
force. 

* ' % 

' Paj^l Pottinger, Director, 
/ National Center for the 

Study of Professions 



•Testing agency si^pporters agree- that testing is important but argue that our 
education system is so complex and variegated that testing's influence is really 
relatively minor. Compared to the amount of time ^students spend doing other 
things, their involvement witii standardized tests is almost negligible/fT^d * 
compared to the billions of dollj^s spent upon education, the millions spe/n^n 
testing do not amount to very^jmuch. Like any other companies, the^sting 
companies are subject in variouk ways to the regulation of the market, their 
supporters argue. Test publishing i^ a competitive business in which failure to 
be accquntable to customefs can spell economic fa,ilure. * . 

The major admissions tests' are developed and administered under policies 
determined by associations of school and college people>, independent client 
groups and trustees. Testing is furtheij^ regulated by professional standards, such 
as those published by the American Psychological Association. Tests ate widely^ 
reviewed in journals and in Oscar Euro's Mental Measurements Yearbook. Were 
there valid professional criticism of particular tests, they could not survive. 
Companies are also subject to court decisions, since any test can be le^lly 
challenged and many have been. Far fjom being secre^t, the companies iee 
themselves as remarkably open, for competitive businesses. They- publish 
numerous reports abpi^t their tests, they sponsor considerable psychometric 
research, they make past tests available, and they make every effort to tell test 
takers and users about the^ Ijmitations of standardized tests. Test agency 
supporters believe that 'critics have confused test security — a technical issue — 
•with secrecy^ The^ agree that they -are intent upon keeping tests secure, but/ 
they do not believe they are secretive. ' 

( ■ ^ . ■ ■ ^ ■ k 

One» who examines th^ arguments about test company power and lack of 
accountability will find the truth of the matter elusive. Power, amount of 
regulation and secrecy are all relative. Individually and collectively, test 
companies clearly have power, but is it **too much" power? Cleariy they are 
subject to some ^market, court and professliOnal accountability, but is that 
enough control over their activities? Clearly theS^ are neither entirely open nor 
entirely secret. There is too much room for interpretation, of such. matters. 
Commitment to one position or the other must ultimately rest upon beliefs or 
attitudes ,that structure the **facts'' to support a particular point of view^ 



Among those^hings, beliefs abdfct t^he ppwer, Secrecy and accountability of test 
companies will depend dpon beliefs about whether massiye use of standardized 
tests has had a positive or a negative effect upon American ^ucation. # 



Many proponents of\esting lejgislation believe that, on the whole, widespread * 
use of standardized fests for admissions and general educational evaluation 
liaS done more Wrm to Education than good. They argue th»tt,too much time 
that might oth*wise Ite spent learning is sf^ent pifepa^ing tor, administering, 
taking and v^mying about standardized test^. Too, general to apply to any 
particular curricul\im, the tests either deter teachers and itu(ients frpm their 
normal path or force therti to alter their cfurricukim to match inappropriaj^e 
test goals. * ^^ ' ^ ' ' , ' 



Critics of massive\testing also argue that it is inconjpatible witrf a pluralistic 
society. NationaHy normed test? (Resigned to be used anywhere are likely to be 
somewhat irrelevant to the lives and t^oncerns of varies groups. Cultural bias 
of one kind or another - niiddle class,' urban, English speaking, whatever — 
cannot l?e Eliminated. Consequently^ critics charge/many people are judged xby 
standards they do not hpld and many ^are tagged as **underachievers," with 
unfavorable consequences for their lives. Outside the world represented by 
standardized tests, thejj remain outside th^ educational escalator that leads 
others to college aYid the good life. ^ 

f I ' 

In further support of ^heir belief that the conserjiietK^s of .niassive testing are 
more n^gative than positive, some critics argue that the pl*«iemoverreliance on 
these intellectual measures may well lead to \torse social stratmS^ion th^ai we 
had before they came into widespread use, Ability grouping on .thels^asis of test 
scores tends to separate low performers from high performers. Not dnly does 
this practice unfairly stigmatize individuals, it impedes acculturation by 
. keeping social classes separated. Some critics fear that an overreliance up^n'^st 
scores for selection to college may Ifead to a uniforl^ student population and a 
less diverse social talent pool than America needs for healthy social growth. 

Finally, some critics of widespread testing point out that it fosters the cruel 
illusion that people get ahead in America by performing well on achievement- 
and ability tests. There is considerable evidence that getting ahead in America 
has less to do with academic success than it does with motivation, personality 
and advantages or disadvantages conferred by the social class into which one is 
born. These critics argue that the **meritocracy" based upon testing serves only 
to mask the fact that our economic system creates inequities no amount of 
schooling can erase. . , 
■ f — ' ' 



To believe that legislat^ion requiring the dissemination of all 
manneviof information about tests will in any way remediate 
basic societal illk some of which have been scores of years in 
the making, is t^c/ engage in the most fanciful and wishful think- 
mg. 4 
> 

Philip R. llpver and 

Richard L. FArguson, 
American College Testing Program 

A •■ 
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Arguments for the positive influence of testing ujion ec^ication begfn witlt^the 
observation that this is, in fact, a competitive society and people will make 
judgments with* or withput standardized* tests. The judgments they make^ 
with9ut then/^ testing- supporters argue, {^re likely to be "subjective,''- 
introducing tne kinds of bias and discrimination, that* tests have largely r 
eliminated. Ever) if imperfect, standardized tests are betler than "subjec*ij^e'] ; 
measures. • ^ * \ ^ >j 

Testing supporters point out that testing grew in response to public and 
institutional demands. Educators asked for it; it was not imposed upon them. 
The' test companies have performed numerous services for the society at its 
rei^uest, enabling millions of people io coropete fairly f6r scholarships, 
University admissions, promotions, jobs, high pchool or college credit and a host 
of other social* rewards. Although it is tjue that some people mis"^ut on these 
rewards, it i^ equally true that others reap successes they might n(jtt)therwise^ 
have Mad gpportunities^to achieve. ' - 

Testing supporters do not believe that standardized tests play a majo^ role in 
curriculum change. Although some teachers may, indeed; try to teach to some 
tests, they cannot teach to general* ability tests such as the SAT. So many 
factors weigh in decisions ahput what to teach — state, district and building 
guidelines, textbooks, faculty pressures, * and training, tp name a few — i that 
tests ^constitute only a minimal influence. In addition, test publishers always 
warn against overreljance upon the tests in .the handbooks they send to users. 




Reply to 
Criticism: 
Standardized 
Tests Better 
Than Subjective 
Judgments 



Growth of Testing 
Due to Demand 



Tests Don't Affect 
Curriculum 
Adversely ' , 



/rhere are three responses to the charge that standardized tests ignore America's 
pluralism. 'The first is to assert that although there are indeed differences 
among Americanfs there are also commonalities. Educational goals are remark- 
ably similar from school, to school, so it is possible to construct tests that touch 
everyone's experience without insisting that all people are identical. The second 
response's to acknowledge the difficulty of the task and the need for pluralism 
in test construction and review. The testing community believes it has been 

xtrying for many years to reduce chauvinism and cultural biases in its tests by 
• involving people from all walks of life in the development of tests. The third 
response is to ask for empirical evidence of bias and present arguments that 
tests are not, in fact, biased. This is the approaph. taken recently by Arthur 

.Jensen^ in Bias in Mental Testing. Since the problem of measurement bias and 
error Central to the psychometric discrpline upon which testing rest§, the* 
testers argue that they could never ignore it, evens^they wanted to. 



Supporters of testing answer charges that overreliance upon testirig can be 
socially destructiye by agreeing that it is probably so. They note the dangers of 
overreliance upon anything, and spend -much of their time explaining the 
.limitations of tests to their consumers. If individuals or the society itself 
misunderstand and misuse tests to unfairly group children or weaken the social 
talent pool or whitewash deeper social*|^robleimSv ther% is little the test 
companies cah do about it. They have tried to inform the public but the public, 
must be responsible if it does not listen. The quesj,ion of misuse w^ll* be 
examined later, after the arguments about the quality of standardized tests 
have been considered. 



^^ests Address 
sfommonalities 

Test Makers Work 
to Minimize Bias 
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B. DEBATE ABOUT THE QUALITY OF STANDARDIZED TESYS* 

K 

«< • 

Beliefs about the impact of standardized testing companies Uf>on education are 
inseparable from beliefs about the nature of standardized tests themselves. If 
there were a consensus about the nature and quality of the tests, the debate 
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Debate on Test 
Quality and Nature: ' 



about widespread use of them wpAld be easier t0 rtsolve, But-thert is*no §iich 
cofisensus and never has been, ejil^J^ outllde or inside the testing commuhity, 
Mixch of the criticism of tes^ompanies and the morpentum for ]eds/ation 
stems from concern about the characteristics of standardized tests and tHeVery 
assumptions upon which they rest. Even though testing legislation aimed 
pnmarily at admissions tests i.e,, aptitude tests — the debaters constantly 
introduce information ajDout all t^sts. • ^ 

Several theoretical aiid\practical witicisms of standardized tests he relevfuit / 
ihere ^because they have either been brought up in testimorly or a/e implicit in/ 
the legislation. The theoretical criticisms include questions about tfcie model ojf 
human behaviot upon whicl^ modem testing rests and testing's status as a 
science. The practical criticisms inclucfe technical questions about the objectiv- , 
ity of tests, the procedures employed in validating them/ and the forinal 
characteristics of tests. The following brief discussion of thes^ issues will npt do 
justice to their complexity and sophistication. It is intended only^o further 
establish 11 relationshiy between the immediate issue of testing legislation and 
other deeper educational and social rifts. 

: , ' ^ ; ^ 



Hispanic communities have long been victimized, we believe, 
above and beyond any other identifiable population, by certam 
ktnds of tests, including thb principal standardized assessment 
instruments suc^i as the sjz GRE, I^AT, MCAT and others, ^ 
because of the well-recognized lin^istic and cultural biases 
agQinst Hispanic Americans that those tests have built into 
them. The testing services have not done enough to" counteror^ 
control for these non-validating ^on-predictjve: distortions of 
the test scores when applied to Hispanic Ammcan populations, 
and we believe that the proposed H.R. 494^ aflf well as at least 
one additional feature in H.R. 3^64 represent a first and long- 
needed step in improving the situation of our community. 



Gary D. Keller, 
Hispanic ^igher 
Education Coalition 



At the highest level of abstratetion, the debate about testing is another 
manifestation of the as yet unresoTVed 17th century debate between rationalists 
and empiricists iibout the nature of the hunpian mind. Some might ev^n argue 
that the Platonists and Aristotelians are onoe again'doing battle. One does not 
need to be a philosopher to know that there are many ways of looking at life 
and some of tRem always seem to be in conflict) In this case, the. very fact that* 
testing arose out of one perspective af)out human behavior guarantee^that 
people with a diffek>il pej-spective will not aQL-ept some or all of-its premises. It 
is safe to say that some of the antitesting emotion in the air is antibehaviorlfim 
or antiempiricism or antipositivism; it is a philosophical antagonism unlikely xo 
be resolved by any amount of data. / 

« 

Another contributor to the antitesting point of view is the historical and 
theoretical association of standjydjzed tests with IQ tests, to which they bear a 
family resemblance. Critics believe that IQ test research is weak, that the 
developers of the tests, made simplistic assumptions abou^j. human intelligence 
and that IQ scores have been widely misused. The images of IQ tests and the 
aptitude tests that resemble them are not helped by the absence of a scientific 
consensus about the nature of inteUigence, ability or human learning. Critics of 
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jtests pqint to this general theoretical weakness, and overreliance upon a v*ry 
limited psychology as evidence that standardized tests rest upony a shaky 
foundation. X * T 

Since the ^machine-scored multiple-choice tests at issue in testing legislation are 
often called **objective'' ^sts, in contrasts to "subjective** ^measures, it is 
important lo note*' that many critics of standardized-tests do ndt consider them 
objective In any commonly understood sense. In fact, critics resent the Tact 
that tests are describe^ with^such loaded words as **objective," **reliable*' and 
** valid/* charging that the public unflerstands such words in one way, while 
tester? are using them in^anoth^r .way. Any ability or achievement test is the 
reslilt of numerous \}uy\m judgments- about IKe theory behind a test, the 
content parameters," what is important within those parameters, how many 
questions' shouid be a^ked to establish knowl^dge of a concept or process, y/hat 
^ the^irections should ^y, what constitutes a godd question, what constitiR^s a 
right or wrong answer and dozens of other things. The only aspect of a test that 
might be termed objective .is the scoring, which is ^one by .a machine instead bf 
a human .being. But machines are not really objective; they simply count 
blackeoed ovals, a very specialized sort of task they will carry out however- 
absurd the test the^ are scoring. Critics of the tests argue that it is misleading to 
imply .that without these ^'objective" tests we are left with the opposite, 
^^subjectivity." In fact, the opposition should only oe between **machine- 
scored^' and **human-scored,'' a very different matter. Nor should the word 
^ **subjective*' be used disparagingly, since 'grade point average, an accumulation 
of subjective judgments^ is superior to test scores as a predictor of §U4Ccess in 
college and since subjective judgments form the basis foj: our legal and political 
systems, not to mention a host of other essential human activities. The framing 
of the debate in* simplistic **objective*7**subjective" terms is disingenuous and 
unfair to both sides. ^ 



If proposed legislation is passed, it would certainly destroy the 
important elemer^ts and direction the New Medical College Ad- 
missions Test has taken; it would 'undermine the confidenceihe 
Ad'missipns Committee members place in it as a tool for admis- 
sion, and it would certainly make the admissions 'process jnore^ 
subjective. Furthermore^ this requirement could potentially leafi 
to the development of Jocal tests which would increase the 
burden on candidates with limited resources and there would be 
no assurance of the same standard quality. 

, D.K. Clawson, Dean; 

College of Medicine, y 
University of Kentucky 



Because the creation of aptitude and achievemj^nt te^ts inv^ves.a great many 
human judgments, it is not surprising to discover that virtually any test will 
contain itemfe with which someone canf^fincj fault. Critics of the tests delight in 
ridiculing the inept, absurd or wrong-headed items that sometimes turn up. 
How scientific^jj^n the process be, they ask, X — in spite of numerous review 
committees and diligent quality control -~ t\je tests still regularly include these 
* t*ringers*'? This^ question evokes a commort technical criticism of machine- 
scored, multiple-choice tests: namely, that they have too little **val)djty,** even 
according to the standards developed 'by the psychometric community itself. 
The^Standard^, for Educational and Psychological T^,sfs, . published by the 
American Psychological Associatior^and often mentioned both in legislation 
and in testimony, require at l^ast one ofHhree types of validation for every 

In 
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Validity ktu^^es 



1 



Questioning 
Validity Studies 



More Criticism: 



commercially published tegt, depending on its intended use: (H) predictive 
validation (is there evidence that predictions made on the basis of the test score 
will hold up, according" to other measures of aptitude or achievement?); (2) 
content validation (how thoroughly does the test sample th^ clasftof situations 
or subject niatter about ^which conclusions are to be drawn?); or (3) construct 
validation (what theories will account for performa^ice. on the test and explain 
the meaning of high or low performance?). If a test has beeB-designed to 
predict success in college, the test developer should conduct studies ^that 
establish clearly the extent to which it does so and with what margin of error. 
If a test is designed to permit generalizations about one's level of reading 
comprehension, the test developer should produqe some definition of compre- 
hension, evidence that the items address the concept and evidence that students 
w|io do poorly on the*test cannot comprehend reading materials. 

Although all test publishers conduct validity studies, critics of the tests charge 
that the studies are either poorly done or done^with such a narrow focus that 
validity has not been assessed /©r the majority of uses tOv^JirhicIj a test will be ' 
put in the real world. For instance, ap aptitude test may well predict first year 
success at a certain type of university bilt not predict success beygnd the ^irst 
ir or^^at another type of school or for another curriculum or for a different 
fopulatiori of candidates. Content 'validation is very difficult to establish. A 
"subject ar^a is so complex a^d the constraints for a given test so limiting (e,g., 
it must be short, it must be.,machine,scorable, there must be right and wrong 
» answers, etc) that every test is severely reductive. No test can hope to address 
more than a fraction of the assessable content, -yet that 'fraction* must 
* 'adequately represent the entire area. Building a chain of inferences from such a 
^ nfarrow field to conclusions about the test taker's grasp of an entire "Subject area 
"♦or the test taker's general ''aptitude" is not easy. 

^In short, validity studies are difficult to do and almost impossible to to 
everyone's satisfaction. Critics of a test can question its ''face" validity 
(whether it appears to a reasonable person that the items measure what they 

.purport to measure) without conducting any kind of study; they can question 
the predictive validity of the test in different situations; the comprehensiveness 
of the content and the relationship of items to the subject matter; and the 
entire theoretical framework upon which the test is based. The room for 
reasonable disagreement about each kind of validity allows for disputes of a 
magnitude that one rarely finds in the hard sciences. We should not be 
surprised, then to find critics faulting the test companies fornot living up to 
thejr standards when those standards themselves are s6 dfifficujTto achieve. 



The legislation before this comjnittee (princi]^aUy Sections 3 , 
and 5 of HR 494^ and tc\a attain degi^ee section S of HR 
304j^'cqlls for all informdtion^ ta be a mattef of public r!ecord 
rluher' than^^th^^^^^ a "test producer chooses tp make avail- 
ahe. Pw6i<c^dc^TOmfa6//i7y in the largest sen^e is what the legis- 
lation c/ehianck.. Given Jhe role that tests play in American lifcy 
such\t demand^^not unr^sonable.. , 

/ ' ' ^ ^ yito Berrone, 
yniver'sijty of NortW 'Dakota 



Besides attacking the^ theory behind standardized te^sts, the ^ul^f^tivity in 'their 
developrriient, their] validit}> and the meansiwsed to establish validity, critics also 
attack the very formfoi the test. Some point put thdt the n^ediuna of 
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standardized testing is also-^ft message about life. The various mess^es student* 
receive from standardized, multiple-choice tests, according *to critics, include: 

* We should alw^s follow dii^ectidns. ^ • ^ . 
2. There are jight and wfong answers to every thing* 

^3. Guessing is bad. * 
4. Facts arairAportant in and of themselves. ) 
5^ Attitudes, creativity, imagination and feelings are not important. 
^ . 6. Intellectual ability is the most important of human attributes. 

7. Fast work is better than slow work. ' % ' 

^ • 8. Blackening ovals is more educational than writing* ^ 

* Some critics have argued that t^ese formal characteristics discourage deep' 

\ \ thinking or reasoning (some would say they pe^nqlize deep thinking), undermine ; 

^ the value of writing and epcourage passivity that renders real learning 
* imfSossible. Educat^ors who believe that the form of an evaluation should be 

^ compatible with the nature of the 'thing beirig^ evaluated (i.e., learning) find 

gjreatesf fault with the tests on these grounds. * 

^ A final ir?tportant criticism of standSbrdized tests is oj^e voiced within the testing 

/I community as. often as it is voiced 'outside: they are wi(iely misused. Some 
teachers mistakenly tesfch to them, some teachers 'draw unwarranted^onclu- 
sionS abt)ut students', intelligence on the basis of test scores, and some schools 
use them to screen rriiTtorities ou^ of college-bound classes. Someadniinistrators 
use them to ev^.uate teachers, some administrators use them as the sole 
, , indicator of Uie Sfcfiool's quality, and some school boards and legislators draw 
^ . unwarranted conclusioiis about schools on the basis of test scores. Finally, 
govpri]menti!>irogram| use them for impact evaluation and allocation of funds, 
' and medi$i overestimate their importance and overdramatize them. 

The test cotopahies assert that ^ey diligently warn users about the limitations 
of the tesU smd the caution. with which interpjretations.ef scores must be rpade. * 
' But the of^tics jfessert that in this respect they resenible the gun lobby, which 
steadfasWy insist^ thene is nothing wfong with guns per se — it is gun users we 
should worry sMout The comparison of tests to guns is unfair, hut the'^point is 
important: tb^t^eis a national disposition, critics argue, to accord numbers and 
''things scientific an - unquestioned respect, if not a primitive sort of worship. 
With gullibility so universal, the test publishers' efforts to discourage misuse 
would be doomed, evert if they tried as hard as they could. Critics contend, of * 
^ course, that they are/nqt trying^ as hard as they could. No one jeitpectff a 
^ cympetitive business tb advertis6 its weaknesses; rather, we expect th^ni to be 

proud of their produjtts and stress their virtues. Although it is true that a part 
of any test publisher*s time is spent warning people about tests, a much* l^ggr 
part is devoted to cultivating the sort of scientific image necessary tp c^epe 
confidence in the tests and increase sales. And it *Kt<M;4his reason"* that rJSoy 
, people advocate testing legislation.. They believe, that the test companies are by ^ 
. their very nature, incapable of dealing with mis^je,, even though they may 
sincerely desire to do so. r ' ^ 

What can one Say when someone suggests that your theoretical base is. weak, 
your* tests can seldom fully meet eVen your own standards for validity ^ your 
instruments convey msidious messages about life, your product is too liable to 
be misused, and there is little you can do about any of it? 

* To begin with, you make the pqint we began this discussion with: There are dif- 
/ ferent frarhes of reference involved and matters do not appear so grave if one sees 

thetn from within the perspective of the empirical tradition of psychom'etric 
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research and theory. Furthermore, many of the charges leveled against testing 
can be fairly leveled against the educaticinal tod '8ocial\ systems whose 
needs, prejudices and failures the tests simply mirror, th^ettejr the tests serve 
society's needs, the more vulnerable they are to" attacks that should rightly be 
directed at that society. « * - 



The test mesBengers, like thermometers^ are telling us that we 
have a worsening illness. Rather than seeking a cure for the 
disease, those for whom the test results are most threatening 
would ask you to restrict, and preferably destroy the use of 
thermometer^. Like Persian kings^ they would slay the mes- 
sengers who bring them bad tidings^ 

Frank W. Erwin, American Societjj' 
' for Personnel Acfininiitration 



There have always been problems with thj^ theory and applica1;ion of IQ tes^fe, 
but jthere have been problems with any number of things in young sciences like 
psychology and sociology, as Well.jNo one will escape fti6m.' The important 
point is that professionals in tl:)£ field are conscientious about testing their, 
theories, cosbucting research ana improving both the theoretical and factual 
base of their discipline. If one wants to argue that testing should cease unt^} we 
have adequate theories aBout intelligence, ability or learning, one might' as well 
argUG to cease educating entirely, for education, too, lacks sufficient theory. 

T^esting's career is ho more checkered "than education's (or business' or 
polities'), supporters of the tests argue. There is probably not a single school 
age or older American who could riot cite at least one instance of unfair 
treatment by a teacher or a school system. Testing supporters argue that the 
arbitrariness witl;i ^hich students are treated and grades are assigned is a scandal 
that has had worse impact upon individual lives tKan anything connected with 
standardized tests. Feeling • that they have created a great many helpful 
instruments that* have contributed to fairness and accuracy of evaluation, they 
resent being on the defensive. Testing, an effort to bring greater precision and 
objectivity to human judgments, needs no apology. ^ \ 

::.^est makers d6 not see their use of the words objective, reliable, valid or 
subjective as deceptive. The precise meanings they give the words reliable and 
valid are spelled out in hundreds of publications; theiruse of objective both fits 

* within a scientific definition (if the results are replicable by sfomeone else, they 
afe objective) and common parlance. They use subjective much like all of ul 
do, they believe, to simply class judgments made by indi\*duals. 

Test makers have never claimed that the test development process was 
objective. Rather, they stress the fact that the process «)f developing tests 
involves bringing many individual judgments together to create a consensus, 
thus lessening the potential effects of any individual misjudgment. They try to 
marshall the best judgments available about a test's subject matter; they use 
educators to design and review tests and items; they diligently field test their 
materials and scrutinize them for a variety of problems. They always hope that 
a test reflects the best professional opinion available, but they know that 
dissent is always possible. If a test reflects one professional point of view and 
other- professionals with different points of view challenge^^ts dontent or 
construct validity, the fault lies not with the test but with the profession. If 
professionals in the learning areas are divided, there will always be some who 
can question a test's validity; that is just* something test makers must live with. 



Testijig supporters believe that much of the criticism aimed at standardized 
tests is baseii upon n^isunderstandirig^ of the purposes for which most of the 
tests are designed, ^For instance/ critics who ^^chargei .that mac|iin6-scored 
achievement tests do not provide substantive diagnostic information are missing 
the essential point that most "such (excluding explicitly diagnostic and 
certain* criljerion-referehced tests) are not designed primarily to provide' that 
information. The tests are inappromiate subjects for ,classroom study because 
they are not designed for that either. Aptitude tests for admissions purposes are 
designed to discriminate among individuals injpuch a way that the* people who 
perf6rm best, are most likely to succeed in their first yclar of college. A good 
item is one that will spread scores out, whether or riot it is **relevjemt" to the 
students' curriciflum or experiehpe. tests' m^or^unction is not to instruct 
*or diagnose, not to encourage creativity, not to promote individualism, nbt to 
assess higlj-level cognitive skills, imagination, attitddes, compassion or sens^pf 
humor — teachers can do these things better thaa macKine-scored tests. Th^ 
standardized, norm -referenced test's major funption i/sm^y to rank-order the 
test takers. People who want to make sorting decisions about large groups of 
students administrators, admissions officers/ counselors — want thijs 
information. The test publishers believe that their teste^arry out that limited, 
but important, function very well. -They hope that^mer people take care of 
creativity, compassion and the other important human qualities that do not 
readUy lend themselves to standardization and a machinerscorable format. 

' This point is worth stressing because it Underscores an important difference in 
perception between the test makers artd their critics. Test makers believe they 
^e performmg a particular educational service, tb a particular clientele and that 
xhey are d6ing this very we]|)i.^ ThSV argue* that, for making gross judgments 
about large groups of people, their t^sts w6rk^ Students who score 80Q on the 
SAT will do well at Harvard aijd student^* who' «cofe> 30^^ will nof. The 
difference between students who score 55t) and'575 is more prgblenialie, set, 
test makfers befieve people who make decisions should require more .informa- 
tion, arid, individual test takei^ should have mbans ofredress in the event that 
their scores a^e misused. • ^ / - , * ^ 

Test makers agree with their critics that validation — particul^ly.constWc^ 
validation ^ i^ difficult, and interpretation pf correlations i^^tJricky business. 
But to say this is dky to say tjiat^ideals^are seldo^i^chievable. As long as 
testing has critics and remains a competitive business, testing agencies will be 
motivated to improve their methodology. ThQ ' l^est /Way to discourage 
improvements, they feel,.WQuld be to* regulate testing in a wily th^t removes 
any competitive- advantage /ne>y technique trSght bring: SonteyCest supporters 
see the proposed legislation as jusj such, a dampening influcmce upon their 
motivation to msjie better tests, J 

As for criticisms of the implicit messages in standardised* tests, the {est makAs 
do not agree that the messages ^e there. They feeK^that students are much' 
more likehr to .receive insidious messages from the schools than^from the tests, 
which only reflect other people's values. If our educational system itself 
teaches cnildreri to follow direCJjon^ believe ev^ry question has a rigftt or 
wrong answer, ^believe gues§ing is ba^^ faqts are important in thfemselvjes, fast 
work is better than slpw and intellectual ability is the most im{)ortant of 
human -skills, then critics should put the ^lame where it belongs.^ or\ the 

system^.'not the tests. * 

a' 

Finally, as mentioned earner, the test makers feel that .charges of misuse-are 
largely unsupported, buFthat they are as concerned about misuse of their tests 
when it does occur as anyone else. Although they believe legislative hearings 
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legiihtion Will 
Not Correct 
A buses * 



have helped educate the public about the limjtations of tests, they mosi 
stirongly^disagrea with those who say toting legislation is the only answer to 
the problem, Sklggestion^ for nonlegislative ipil^ovements will be reviewed later 
in this report. " . ^ 



Students dearly want 06dback on these£xams which iiifluence 
the course of career and life. The Congress ^should act to equal- 
ize curre^htly available a4vantagesjn corrimercial ''cram'' courses 
by providing^flctual test re^onses and corrections directly Jo 
students. The public fteeds more data and better means of scrji;^ 
tinizing the test industry. • . . ' . v 



, David Gastfriend, 

National Coordinator; 
Committee on Medical Evaluation, 
American Medical Student Association 



M<iny Issues 
hailed are 
Irrelevant 



/ 

Observations , 
(1) Testimony 
J Seldom 

' Differentiates 
Amohg fe^ts 



(2) Partisan^O0US 
, on Different 

Educational 
Aspects\ * 

(3) Different N^cedi^ 
for Information 
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C. PATTERNS IN THE DEBATE 

y \ / • ^ ■ 

The brief review of arguments about testing dhat have been raised in legislative 
* hearings is unfair to the sophistication bt many of them. But tlj^e review- should 
serve to dramatize the fact that ^he d^ate includes many issues that do not 
directly pertain to the legislation. Befo^:e the legislation is r^vie^ed in^Mail, it' 
j;xiigbt bfe useful to separate immediate, relevant points from points that, 
however important in their own sphere, do not Jbear directly on the question at 
hand. ^ ^ ^ 

' The first obsqp^ation we pan make is that much of the testimonj^ for and 
against legisla^tion lumps all tests together and either condemns or praises the 
lotr However, all the legislation except the Gibbons Bill (H.R. 3954) and the 
New Jersey bill addresses only tests given ^to Substantial numbers of people 
• seeking admission 'to higher education institutiohs. These are' only a few of the 
hundreds of. tests administered in America, and the population involved, 
though sizable,' is only a fraction of all the students in our sf2jiools. Many 
afgument^ for legislation^ are based upon the characteristics „use^ and effects of 
tests not at issue in any existing legislation. This is partly because it is^difficult 
to draw clear lines between the ability tests in question, vyhich assess general 
aptitudes developed over mahy years, and achievement te^s, \yhich focus more 
- upon recently Acquired 4mowl^ge But obviously test aptitude as well. It is 
partly because ^ome people think about tests only in terms of selection or 
allocation and bthersi:think irf terms of diagnosis or counseling. And it i^ partly 
bedause sortie people feel they must attack or defend all testing. But it might be 
more productive to limit' debate to only those tests and students at issue. When 
one does tha^, the wsen^al- issues become easier to discern aiid alternative 
courses of action become clearer. * . • / 



A related observation about the deb^e is that each side t^nds to focus upon a 
different aspect of the education pRr^rise. Education is & complex hi^archy 
that/begins with the individual student and his or-her teacher and moves. up to 
the classroom, the building, the stat^; the region and the federal government. 
There aire different information needs at each levdj|t£pr different* actors — 
principals, curriculum designers, sup^intendents, sclrool boards, state^ educa- 
tion department personnel, federaj program administratqrs or even federal 
court judges. Obviously, some people in some,p,arts of the erfterprise need kinds . 
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of information that other pebple do not ne^ it alf> The individital teacher 
knows the most .aboirt the; individual child^ he or she does not ijeed 
vdardlzed tests to identify ihe good and the hid students. But school 
Irds, taxpayers, state education department people or University adniissjpns* 
officers do not know what the teacher k^ows and need a quite differerit kind, 
of infbrtftifition* .Afititesti^l people tend to focus more upon the individual 
teacher and student and their infom^ation needs than upon people elsewheire jrf 
the system who have different or more abstract needs. Pro-testing peopUtend 
to see themselves as servants of those peop^p \n the enterprise who need 
somewhat abstr;a(ct, relatively crude but useful iniformation for • administrative 
'decisions. Antitesting people- argue that tests are bad for educatioti and 
pro-testing people argue that they are useful to education'; neither jpeans the 
same thing by tjie word, '^education." This failure to see American education as 
a multidimensional/ hier€grchical, sociopolitical enterprise dooms debates such 
as this one to eternal irresolution. ' ' *^ 

... I . , ' • 

Another difference in focus that^uses the arguments to miss each*other is a 
natural" consequence of the fact that^me people do well on tests and others 
do not/ Many antitesting people tend^to be more interested in those who do 
poorly, while many pro-testing people tend to focus more upon those who do 
Well. One side talks about opportunities denied, the other about opportunities 
afforded \fy tests. For every example antitesters produce of sopieone 
overlooked because of low scores, pro-testers produce someone who would 
have been overlooked if it were not for his or her high score. 

\ 

This chapter began with the observation that schools serve many important 
functions; education is only one of them. and certification is only one of many 
aspects of education. Many antitesting j*6o]ble value other school functions 
more than certification and find society's exaggerated concern for certification 
repugnant. Pro- testing people may>^so value other aspects of education, but 
find certification a compelling socid need. The question of whether testing 
playg^too great or too little a role in education cannot be answered without 
agreement about the importance of, certification to the society at large. When 
wone puShes the opponents in this debate to consider this larger question, one 
finds that they are likely to hav^e quite different notions about how society 
ought to. operate* Opinions about testing seem tp be tied tq opiilions about » 
inebfuality'in Amterican culture — where it comes from and how it) can be best 
dealt with. Resolution again seems quite unlikely. 

^ ^ r— 



It is gerlerally acknowledged that the disclosure %uould necessi- 
tate the devetbpment of more test questions and more test 
forms than are currently needed; it would be impossible to 
reuse questions that have been shown to be useful and valid. It 
would be unwise to legislate a change of this magnitude without 
adequate assurance. that the quality of information gaihed from 
admissioris Jests will not thereby be compromised, without a 
clear indication of the number and identity 6f the students who 
might benefit from Buch changes, and without a comprehensive 
estimate of the associated costs, 

Richard Berendzen, 
Universitj^rov#«t and President-El^*t, 
# ^ V The American University 



This h^^ef despription of the background issues has emphasized the extent to 
which' the arguments rest upon larger sets of values and different angles of 
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vision. It would be unfair, however, to leave the reader with the imjiE^ssion that 
the debate about the role and power of testing in Anjerica arid tHe. general 
quality of standardized, machijfie-scorabfi^tests is irresolvable. Resolution is 
certainly possible for each individual. It only becomes difficult at the policy * 
le^el because there are several competing public perceptions and interests* at 
stake. Even at this level, however, there are ways of sorting through tfeAn to 
narrow tfie field o^ inquiry to one more congenial to decision making. Some of 
those Strategies and avenues for further study will be* discussed in Chapter Vh 



\ 
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11. THE LEGISLATION 



Proponents pf the testing legislation assume that because so-many people take 
' admissions tests and because the tests critically influence lifelong opportunities, 
Ahis is a matter pf such overriding public interest that legislative action is 
" appropriate. After- all, they hpe argued; we^have l%ws cpnceming'^*truth'' in 

most other areas and there is ample precedent for regulating public utilities or 

industries that like, this one — are virtual public utijities.^ 

• Before examining the legislation^ however, it is important to note that 
representatives of the testing companies jio not accept these premises. Testing 
legislation, they feel, should only bC^considered yrhen a critical problem has 
been established and all other remedial measures "Have failed. They do not see 
that any such problem has been established by advocates of legislation, either 
prior to the New York law or in subsequent hearings on the federal bills. 
Pointing tci^me evidence that more than half of America's students apply to ' 
two-year schools that do not require standardized, entrance examinations and 
that, of all students going into undergraduate? higher education, 90 percent are 
admitted to their first choice institutions, they doubt whether there is a real 
need for legislation, especially at the federal |^vel. Many people in the testing 
community agree ^ith the spirit of the demands for more information for tfest 
takers, but feel that the. agencies can meet them without legal coercion; laws, 
especially if hastily ensicted, would probably do littlej;p correct abuses and 
could conceivably do mqye Ipng-term harm than gogi^T ^ *^ r 

The appendixes contain copies of the New York and California laws, as well as 
the Gibbons and Weiss bills. Tables 1-3, at the end of thi3 chapter, summarize 
the major aspects of each, as well as bills that have appeared in other stages. 
Following are some general observations about the bills^and laws. 



Proponents*' 
Assumptions 



Opponents* 



> 



Reply 



Major Legislative 
Characteristics: 



$tate Level 



I 



•Only California and New York have enacted laws.^In other states, some 
proposed laws have died^^ia-^^oij^^ some have been defeated and some are 
still pending. It is difftcult^to keep current on tl^ese biljs, so interested readers 
shoula contact state legislatures to get the most accurate information aboKit 
their status, - ' ^ 



State Level 
Legislation 



states usually propose to entrust enforcement to the . -agency responsible for 
; postsecQndary education. Suggested so far are the New York, Florida, New 
•Jersey and Pennsylvania Departments of Education; the Colorado Commission 
on Higher Education; the Maryland Board for Higher Education; the Ohio 
Blbartnjjr Regents; thd Coordinating Board, Texas College and Universitji 
System^ and the Califopia Postsecondary Education Commission. The fact that 
theter-j^B^ agencies are somfewhat different in ^aracter and brfead^h of 
spol^ilities suggests a^potenttial for state to state miscommunication-and 



rest 



conftfeiwi if more laws are enacted^ 



State Enforcement 
Agencies 



V 



> 



"Most bills call for filing of ^1 reports, studies or evaluations done in connection 
with ^.he tests. There is disagreement about (&) vfhX) owns these reports (the test 
Cdml)anies believe they ate^re property of individual institutions) and (b) 
whethei^ this requirement infringes upon academic freedom to do research and 
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Federal 
Legislation: 



The'Weiss Bill 



select candidates. See CItapter IV for more about this. Unjiike any of the others, 
_tha-JMaw . Jersey bill applies to virtually all staindardized testingv including 
achievement tests and cofnpetency tests jwch as the^Minimuiri Basic Skills Test 
and th^ New Jersey Collegiate^ Basic Skills Test. ^ 

Federal Level - H.r! 4949 (Weiss) 

In the propos^ed legislation, the U.l^. Commissioner of Education is charged not 
only with housing the statistical and financial dat5,,but with **reporting" to 
Congress about such matters as the delation of test scores to background 
characteristics §nd the^success of test preparation courses. Some critics of the 
bill see potential here for the e&tabli^ment of an unnecessary bureaucracy and 
jure concerned about the nature of |his reporting. ' * 

The Weiss bill requires test companies to tell test takers about th^ extent tb^ 
which a test preparation coUrse will improve their scores on particular tests. 
There is considerable" controversy about (a) whether **cram courses" could ever 
be uniformly characterized in any )iuy useful to serious researchers; (b) 
whether any such courses really impro>^scores; (c) whether, if any do, they do 
for all tests or just some tests; (d) whether it would be worthwhile to enter 
into this area at all. The bill would also exclude all admissions) .tests given to 
fewer than 5,000 students per year. 



The Gibhona Bill 



(Gibbons) ' . ^ ^ 

This proposed bill applies to alt standardized tests — aptitude, achievement, 
occupational or Whatever — written or oral: Thus, it goes far beyond any other 
^ proposed or enacted legislation, reaching into all levelsi of educational and 
employment testing, including civil service examination. Offsetting its ambi- 
tious range is the*fact that "It does not require anybne to file anything with a 
federal agency and it does not call for full disclosure. Consequently, it gets 
scant attention compared to tjie Weiss bill. . . ^ 

. V 

The bill requires test pubKshers to diviiige the **cutoff" scores required for* 
higher educati^ institutions. Test companies find this quite beyond t^eir 
respqnsibility, since they do not even recommend cutoff scores and have no 
control over people who use them. ^ . * 

> * ^ . 

Section' 6C appears to rule out all norming, a curious provision given thfit some 
of its other requirements cannot be met without |«orming. 
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Table 1 



STATE TESTING LEGlSIATION, ENACTED 



LAW 



New York 
(S'5200-A 
7668-A 
C^l* No* 
1215) 



TESTS TO WHICH LEGISLA- 
TION SPECIFICALLY 
APPLIES 



Any standardized test 
used for postsecon- 
dary or professional 
school admissions se- 
lection 



TESTS WHICH LEGISLATION 
SPECIFICALLY EXCLUDES 



Civil service exams or 
tests used for any 
other purpose; 
Advanced Test of 
Graduate Record 
Examination; College 
Board Achievement Tes 



1 




mustVdisclose to 
stateXagency 



Test agency must file 
with Commissioner: 

. Pertinent background 
reports 



Pertinent reports, 
including explana- 
tion of score scale, 
standard error and 
available correla- 
tions between scores 
.and grades, cQurse 
work and parental 
educat ion 

Test questions and 
answers used for raw 
score 

Rules for transfer- 
ring raw scores to 
final score 



MUST DISCLOSE TO 
TEST-TAKERS 



NOTES, SPECIAL 
PROVISIONS 



Must, send to test-taker Full disclosure law 
upon request: 



Test questions and 
answers and answer 
sheet 



. Raw score 

information test agency 
must provide test- taker 
dt registration: 

. Purposes of tes^: 

V Intended uses 

. Subject matter, know- 
ledge and skills 
f being measured 

. Explanation of score 
scale, standard error 

. Available correla- 
tions -between test 
scores -and grade 

How scores will be 
rfef ported 

.Who owns the scores; 
how they will be ^ 
treated 



Agency must also make 
public any reports 
prepared for indi- 
viduaj^ institutions 

Test items used for 
field trials or com- 
parability over time 
may be withheld 

Scores cannot be 
sexit to institu- 
tions without 
specific consent 
of test-taker 



STATUS 



1-1-80, 
>ef fective 
date 



29 ^ 



30 



{ 



California 
(S.B. 2005) 



TESTS TO WHICH LBGISIA- 
TION SPECIFICALLY 
APPLIES 

An^standardized test 
used for postsQcon- 
dary admissions se- 
lection given to more 
than 3000 students/ 
year 




TESTS WHICH LBGISLATIOjl MUST DISCLOSE TO 
SPECIFICALLY EXCUJDE^ ; -<^ATE ACBNCY 



MUST DISCLOSE TO, 
TEST-TAKERS 



!JOTES, SPECIAL 
PROVISIONS 



Tests used for re- 
search, pre- test, 
guidance counseling, 
placement or meeting 
graduation require- 
ments of secondary 
schools 



within 90 days of close 
of each testing year, 
test sponsor mu^t 
file with Post- 
secondary Education 
Commission: 

. Test questions 
equivalent to those 
used on secure test, 
plus answers 

. Data about predictive 
^validity of grades 
alone, score alone, 
grades and score to- 
gether 

* Information conform- 
ing to APA guidelines 

Within 185 days afte^ 
close of testing year, 
test sponsor must re- 
port for each test: 

* I of times test 
taken 

* I of individuals 
tested once, 
twice and more 
than twice 

. t registered but did 
not take • 

Total amoiyit of ^ees 
received 

Expenses incurred* 



Similar' to New York Not full disclosure 



ex-cept for full 
disclosure df 
items 
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Table 2 



STATE TESTING LEXJISLATION, PROPOSED ^ NOT^ENACTED 



TESTS TO WHICH/t^GISIA- 
TION -SPECIFIoiLY 
APPLIES 



TESTS WHICH LEGISLATION 
SPECIFICALLY EXCLUDES 



MUST DISCDOSE TO 
STATE A(^NCY 



MUST DISCDOSE JO 
TEST-TAKERS 



NOTES, SOCIAL 
PROVISIONS 



Any standardized test 
used for postsecon- 
dary admissions se- 
lection given to more 
than 3odo students/ 
year \ 



Tests used fof re- 
search, prer-tesfe, 
guidance counseling, 
placement or meeting 
graduation requiremei^ts 
of secondary schools ' 



Provide' Oolo, Oomnission 
on Hitler Education: 

Within 90 days of close 
of each testing year, 
test Sponsor must file: 



Background and 
explanatory material 



Not full 
disclosure 



* Test questions equi- 
' valent to those used 

on secure test, plus 
answers 

. Data about predictive 
validity of grades 
alone, score alone, 
grades and score to- 
gether ' 

* Information conform- 
ing to APA guidelines 

Within 180 days after 
close of toting year, 
test spon^cu* must re- 
port ^f or each test: 

, # of times test 
taken 



\ 



.# of individuals 
tested 

once, twice and 
more than twice 

# registered but 
did not take 

V 

Total enount of fees / 
received 

Expenses incurred 




BtLL 



TESTS TO WHICH LEX5ISLA- 
TION SPECIFICALLY 
APPLIES 



TESTS WHICH LEGISIATION 
SPECIFICALLY .EXCLUDES 



MUST DISCDOSE TO 
STATE AGENCY 



MUST DISqUOSE TO 
TEST-TAKERS 



NOTES/ SPECIAL 
PROVISIONS 



STATUS 



Florida 



to 
o 



35 



Any standardized test 
used for postsecon- 
dary adinissiorts, 
financial aid for 
placement. 



Civil service or job 
placement tests 



Provide Dept* of Educa- 
tion background . 
information: 

Within 90 days of close 
of each testing yeat, 
test sponsor must file: 



f 

♦ ,Test questions equi- 
valent to those used 
on secure test, ^pl us 
answers* 

♦ Data about predictive 
validity of grades 
alone, score alone, 
grades and score to- 
gether 

. Information conform- 
. ing to APA guidelines 

v/ithin 180 days after 
close of testing year, 
test sponsor must re- 
port for each test: 

. # of times test 
taken 

. # of individuals 
^ -tested ^ ^ 

once, twice and 
more than twice 

♦ "t registered but ' 
did not takp 

♦ tetal amoqpt of fees^ 
r'eceived 



Must send to test-taker Pull disclosure 
upon request: 

♦ Test questions and 
answers ' 

. Answer sheet 

* Raw score ^ 

Information test aigency 
must provide test-te^ker 
at registration: 

. Purposes of test 

. Intended uses ♦ * , 

♦ 

. Subject matter, know- 
ledge and skills 

* being measured* . 

♦ Explanation of score 
scale, standard* 
error 

. Correlations between 
test scores and * 
grades 

/How scores will 
be reported ^ ^ 

\ Who owns the scores? • 
how they Will be 
treated 



Did not pass 



3( 



X 



BILL 



TESTS TO* WHICH LBGISIA- . 

TION. SPECIFICALLY TEOTS WqtCH LBGISIATION MUST DISCLOSE |TO' 

APWilBS . • SPEfclFICALLY EXCLUDBS STATE AGENCY 



MUST DISGIDSE TO 
TEST-TAKERS' 



NOTES, SPfiCIAL 
PROVISIONS 



STATUS 



Pertinent background 
reports, including 
any report made using 
test data 



Pertinent statistical 
daba, including ex-' 
planation of score 
scale, standard error 
and correlations be- 
tweefi scores and 
grades, course w^rk 
and parental 
education 



to 



Maryland 
(H,B* 1425) 



Any Standardized test 
used for postsecon- 
dary> admissions or 
placement 



Civil service^r job 
placement tests 



. ?test questions and 
answers used for raw 
score 
» 

. Rules for, trans- » 
ferring raw scores 
to final score 

Tests and answers filed 
with Dipt, of Education 
within 30 days 

Provide Maryland 
Board for Higher 
Ed* with: 

. Pertinent background 
reports, including 
any report made 
using test plata 

. Pertinent statisti- 
cal data, including- 
explanation of score 
scale, standard error 
and correlations be- 
tween scores and 
grades, course work 
and parental educa-- 
tion. 



UsuaJ. explanatory 
material, plus: . 

. whether cutoff 
scores yilll be 
used ^ : 

. Whether scores will 
be weighted greater 
or less than grades 



Not full disclosure 



Did not pass 
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BILL 



TESTS TO WftCH LBGISLA- ' 
TION SP^IFICALLY 



TESTS WHICH LEGISIATigN ^ MUST DISCDOSE TO 
SPECIFICALLY EXCLUDES • STATE AGENCY 



Test questions and 
answers used for 
raw score 



MUST DISC 
TEST-TAKERS 




NOTES, SPECIAL 
PROVISIONS 



STATUS 



Ohio Any standardized test 

(H.B. 636) for postsecondary 

admissions selection 



to 
to 



Civii;^rvice; iOt te^ts 
designed for placement 
or credit 



. Rules for turansfer- 
^ ring raw scores to , , 
final scores 

Provide* Ohio Bourd of 
Regents|with pertinent 
background for t^§ts, 
incl ud inii - cor r el at ions 
between score's and 
grades, ability to ' . 
graduate,- sociqecononjicf 
status, backgrpund 
characteristics, oc- 
cupational performance. 

Provide' test questions 
and answers. 



Upon request, within 
180 days, provide test 
aubj^t's answer form^ 
appropriate informa- 
tion for understanding 
score. 
- \ 

Must send to test-taker 
upon request: 

. Test questions and 
answers 

. Answer sheet 



t\ill disclosure 



Did not pass 



•J 
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. ^Raw score . ^ 

Infbrination test agency- 
must provide test-taKer 
at registration: 

. Purposes of test 

. Intended users 

, Subjjct matter , know- 
led#l and skills 
being measured 

. Explanation of score 
scale, stfindard error 

. Correlations between 
/test scores aril3 grade ^ 

. How scores will be 
reporte<? 

. Who owns the scores^ 
how they will be 
treated 
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TESifS TO WHICH I5*3ISIA- 
f TlON SPECIFICALLY TEgTS WHIQH LEGISLATICy^ 

APPLIES . ^ SPECIFICALLY EXCLUDES 



MUST^SCIPSE TO 
STATE aIBENCY 



MUST DlSCfiOSE TO- 
TEST-TAKERS 



NOTES, SPECIAL 
PROVISIONS 



(H^B* 59) 



Any examination u6ed 
for determining acj- 
jnission to under- 
graduate , graduate or 
professional scfkx>l 



IfennsylVania Any examinat^n used Civil service exans 
• (S.B/994) ' -^fo'r detenu^ ing * and other non- 



to (H*B^ 2624)*^ admission 
^ '^-'? undergraduate, 



graduate or 
, professional 
school 



admissions tests. 

Advanced .test of 
Graduate Records 
Examination and 
achievement tests 
excluded from 
disclosure 



\ 



Provide Coordinating 
Board, Texas College 
& University System 
with* pertinent back- 
ground data on tesHe 



Pile withr Department 
of Education: ^ 

* Pertinent back- 
background reports. 
Including any report 
toafcle using test 
data ^ • 

. All test 

questions used 
' to caicblite raw 
score and answers 

. All rules for ' 
transferring raw 
^r^w scores to 
final score 



♦Provide at registration 
bridf description of 
exam, profile of scores 
on previous exams, list 
of services 

Provide everyone with 
test questions and 
answers whether 
they jrequGst them 
or not 

^Upon written, request, 
provide all information 
about a test-ta|cer that 
4^ contained irt testing 
service's record% ' 

Provide on request: 

. Copy of all questions 

u^^ to calculate 
^ raw* score-- 

. Answer sheet ^ 

. Ka J score , 

Information test 
agency mufet pro- 
vide test-taker 
at registration: 

. Purposes of test 

. Intended users 



Full disclosure 




Full disclosure law. 

Agency rtltlst a^so maike 
pukflic any reports and 
data pre^red for indi- 
vidual irmt i tut ions ' 

Test items used for 
field trials or com- 
parability over time 
may' be withheld 

Scores cannot i)e 
sent to institutions- 
without jgpecific 
consent of test- 
taker . 
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> . 
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Subject matter, know- 
ledge and skills 
being measured 

Explanation of score 
scalfe, standard error 



biLL 



New Jersey 
(S.b/*'3461) 



to 
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TESTS TO WHICH LBGISIA- 

TION CPECIFICALLY TESTSvWHICH LBGISIATION MUST DISCLOSE TO 

APPLIES ^ SjPEC^CALLY EXCLUDES STATE AGENCY 



Any'test developed by 
test agency for the 
purpose of selection, 
placement, classifi- 
cation, graduation or 
any other bonaf ide 
reason concerning 
pupils in elementary 
and secondary, post- 
secondary or profes- 
sional schools 



a Tests developed and 
administered by an 
individual school, 
schpol district or 
institution or 

""^ployee thereof 
for its ovm 
purposes 



/ 



MUST DISCDOSE TO 
TEST-TAKERS 



Correlations betvfeen 
test scores and grade 

How scores will be 
reported 

Who owns the scores? 
how they will be . 
treated 



NOTES, SPECIAL 
PROVISIONS 



STATUS 



Submit to Commissioner 
any studies, evalua- 
tions or statistical 
reports, pertaining 
to tests, including: 

. Correlations 
between test 
scores and 
grades, ability 
£o graduate, SESf 
occupational 
performance 

Within 30 days after 
results of any standar-,,. 
dized test are released, 
file with Commissioner: 

. Test questions used 
for raw score 

• Answers 

. Rules for transfer- 
or ing raw scores 



At registration: 

. Purposes of. test 

. Subject matter 
measured 

. Score scale 

♦ Standajjd errors 

• Correlations 
between 
test scores^ 
and grades/ 

y\ 

sHow scores 
win ^ 
ported and 
used 

After test filed 
with Commissioner, 
within 60 days 
of requ^t^ 
without fee 
charge: 

. Test qu^^tions used 
for raw Score 

. i\|jiswer sheet 

. Raw Score 



y Full disclosuite 

Includes elementary 
and secondary testing 

Prohibits charge 
for disclosure 
service 

Scores cannot be 
serjt to 
institutions 
without consent of * 
test-takers 




Pend ing 
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FBDERMi TESTING LESGISEATION, PROPOSED BOT NOT EW\CTBD 
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TESTS TO WHICH LEGISIA- ' / 

TION SPECIFIOVLLY TEST^P WHICIJ LEGISLATION MUST DISCLOSE TO 

APPLffeS ^ SPEClPlCALtiY EXCLUDES FEDERAL AGENCY 



V 



MUST DISCLOSE TO 
TEST-TAKERS 



NGTES, SPECIAL 
PROVISIONS 



STATOS 



CJ1 



H*R* 3564 All tests used fon 
(Gibbons) postsecoodary 

edmissions selection 

All tests used for ad- 
mission into any oc- 
cupation. 

% 

All aptitude or 
achievement tests, 
whether written or 
oral 



None 



None 



Provide usual back- 

jjund data des- 
criWirw test charac- 
ter i\tlcs and uses 

Provide score, rank- 
ing, score required 
for admission to in- 
stitutions of higher 
educatlonXy 



Not full disclosure 

No achievement test 
shall be graded on 
the baeis of the 
relative distribu- 
tion of scores of 
other test subjects 
(Sec* 6c) 



Did not pasS' 



H.R. 4949 
(Weiss) 



All standardized tests 
used for determining 
^admis^on and place- 
"ment in postsecond^ry 
<^ education 

All tests used for 
preliminary prepara- 
tion for any above 
ce.^t 



Occupational tests 

Tests designed solely 
for nonadmission 
placement or credi/:- 
by-exainination * 



45 



I 



Provide U.S. Com- 
missioner of Educa- 
tion: 

. Any study, evalua- 
tion or statistical 
repor^t which a test 
e>genc^ prepares or 
causes to be prepared 

. All test questions 
and answers* 

. All rules for trans- 
ferring raw scores 
into final scores* 

Provide Commissioner , 
within 120 days of the 
close of testing year: 

. I of times test 
taken 



Provide te^Sy- taker upon 
request: 

. Test questions and 
answers 

. Answer sheet 

. Raw score 

In addition: 

. Average score by 
income group 

. Extent "to which Ve8t_^ 
preparation courses 
improve test subjects* 
scores 

. Average score by 
Income ,g roups 



Full disclosure 

Cotnnissioner of 

E5ducation shall report 
to Congress relation- 
ship between test 
scores and income, 
race, sex, ethnic 
and handicapped status. 
Also report on ^cess 
of test preparation 
courses * 



Being 
redrafted 



erJc 



TESTS TO WHICH LEGISIA- 

TION SPECIFICALLY TESTS WI^ICH LEGISLATION 

Api>LIES % SPECIFICALLY EXCLUlDES 



MUST DISCDOSE TO 
FEDERAL AGENCY 



MUST DISCLOSE TO , 
TEST-TAKERS " 



NOTES, SPECIAL 
PROVISIONS 



STAfUS 



, Hf of subjects taking 
it once, twice, more 
than twice 

. Refunds given 

. I of subject^ for 
whom total fee 
waived or reduced 

. Total fees received, 
each test , 

. Total revenue, each 
program 

. Expenses to test 
agency • 

V 

Provide Commissi^er 
with information 
about admissions 
data assembly or 
score reporting ser- 
vices: 

. # people registering 



Total revenue re-^ 
ceived 



E)cpenses to test 
agency 



, Extent 'to which 
test preparation 

, courses improve 
test subject^! 
scores 

Information test 
agency. Must % 
provide test- taker 
at registration: 

, Purpose of test 

i Intended uses* 

. Subject matter, 
knowledge and 
skills being 
measured 

, Explanation of 
score scale, 
standard error 

, Correlations 
between test 
scores andr 
grades 

. How scores will 
be reported 

• Who owns the 
scores; how 
they will be ^ 
treated * 

Upon roqueet, provide 
test questions used 
to determine raw 
scores, answer sheet, 
teore* ♦ 



X 



'ests administered 
to fewer than 5000 
subjects/year 
exempted 

. \ 
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III. THE PULL DISCLOSURE ISSUE 



Of all the provisions in the current and pending legislation, none has received 
more publicity than full disclosure. That provision requires test companies to 
return to t*st takers, upon request anji* within a certain number of days of 
release of 3cores, the test questions used irf, calculating their score, their answer 
sheet, their *raw score and the formula by • which their raw score was 
transformed to a normed score. This is the **truth" that truth in testing" 
advocates want told. This is the heart of tifie strongest argument for legislation: 
that as a matter of simple fairness, students deserve to see how they did on t^ie 
test and how their ^performance was 'turned into a score. The public, well, 
deserves to know the contents of these instruments of public policy, Advocates 
of tiie fairness position do not argue that students will necessarily learn much 
about '^aptitude'' by studying their tests, though they might learn about test 
takiffg^Skills and strategies^ nor do they believe that students will uncover gross 

Snfairness or incompetency in scoring, though they might uncover a few* 
listafces that would have gone unnoticed. They filgUe primarily that a common 
sense, man-in-the-street no^n of justice suggests that in a free society people 
should know exactly hov^lhey have been evaluated and judged. Np thing less 
should be tolerated. 



Full Disclosure 
Furore :\ 



The Pro*s Vieur- 
Fairness 



An argument framed in terms off truth, fairness, justice (and we might as well 
add **the American way") is hard to meet head on. Who would urge falsehood, 
inequity and injustice? Consequently, no one has protested the value of the 
goals (expressed by the -radvocates of the legislation. Everyone who testifies 
begins by endorsing therii. However*, the opponents of legislation then shift the 
argument away from the goals to problenrisJrj;(ol*ed in reaching them. Here, at 
the center of the debate, the opponents engage one another least of all: one 
side argues from value?, the other counters with technical and financial data 
that cannot but sound petty |?y comparison. And both sides invoke the 
principle of fairness. * . . 



The Anti*s 
Answer — 
Tests Are Fair 



In The Debbie Over Open Versus Secure Testing: A Critical Review (Strenio,v 
1979), Andrew ^Strenio Jr. has adn^irably detailed the disclosure issue. Readers 
are referred to that report for a more thorough analysis than we can enter into 
here. What follows is a synopsis of points made against full disclosure during 
legislative hearings, points raised by Strenio, and changes in the argument since 
Strenio's paper appeared. The points fall into four classes: (1) disagreement 
about the need for^and utility of disclosure, (2) warnings about potential 
unintended consequences. of disclosures, (3) technical considerations and their 
impact upon students, and (4) questions about the legality of the provision. The^ 
first three will be considered in turn in this chapter. The legal questions are 
reviewed in Chapter IV. 



Disaf^reements 
About Full 
Disclosure ' 
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A. The Need For and Utility of Full Di^sclosure 

Opponents of full disclosure 'believe, first of all, that the test publishers are 
already providing students and users with ample information about the test, its 
properties and appropriate ages^. It is a mi^ta^e, they believe, to think that real 
test questiorts are significantly different from the sample questions provided to 
students in their pretest materials. The sample test for the SAT is a real test 
given in the past; thus, the sample items And the items students will see on their 

1 9 \y 



A. Need For and 
Vgc.of 
Disclosure: 

Testers: Ample 
Information 
^'Pfiwided 



Students Don't 
Learn From ' 
Te8t9 



Pro 's Response — 
Why Not? 



The Answer 



\ 



tests sKare the same propertied, and anything that can be learned Vi)out test 
writersl minds can be learned from the sample items. . ' 

Test makers^ have long argued that the aptitude tests used for admissions 
selection measure cognitive skills developed over a long period of time* They 
cannot be/*studied for'' in the way one might prepare for an achievement test. 
Consequently, theV do not think studjents can learn much about their aptitude 
by studying the test questions they missed. 

In response to this point, some advocates of disclosure ask how good can a test 
be if one cannot learn Anything from it? The riposte is technical and utilitwian:* 
a test can be good if it predicts what it is supposed to, regardless of whether 
one can learn much from it. And anyway, test makers argue, even if there were 
some marginal value in studying an aptitude test, it is heavily offset by the' 
breach in security (discussed below under technical considerations). * V. 



Suggestions for 

Partial 

Disclosure 

4 ^ 
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Need td Get*Mo^t 
Us^ Out of Test 
Versus Need for 
Timeliness 



In an effort to find some middle ground, various parties have suggested plans 
for partial disclosure. For instance, the test companies could announce that one 
or two forms of a tpst will be disclosed each y^ear, but the rest will remain 
secure. Or, every, test could have a specified lifetime, after which it would be 
made public. Or, tests gjven 'on certain pre-announced administration dates 
would be disclosed, but others would not; students interested in disclosure 
could ele^t to take the tests op those dates and students who are not interested 
in disclosure could take the test another time. Another suggestion is that a test 
6ould consist of two" equivalent halves, one of which was disclosed immediately 
and the other of which was disclosed after a year. These plans might 
conceivably be workable for some tests l[>ut not others, given the variety in 
affected tests, test schedules and reporting times. 

Many testing people would be hqppy to disclose tests if they could get a certain 
amount of use out, of them first, to make them efficient. What hurts, they 
argue, is not so much disclosure per se,, but disclosure affer only one 
administration of a test that has been years in the making. Supporters of 
leg^lation cart be sympathetic to' this point of view, but they feel timeliness is 
critical to disclosure if students are to have the opportunity to challenge their 
scores or take the test again. So the issue of partial disclosure hinges, m part, on 
the feasibility of* compromising the students' interest in getting quick 
turnaround with the test companies' interest ip getting maximum mileage oift 
of a giveij test. No one ha^ yet found 4 way to make that compromise but it is 
probably not impossible for some tests. , 
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Pohhtial • 
Dangers of( 
Disclosure 

Reaching to the 
Test' 

Pro's Response 



Boon to Test 
Coaching Schools 
Yes or No? 



B. Potential Unintended Consequences of Disclosure 

Crit|jps of disclosure have warned that the existence of a large number of test 
/iten>s would present some danger of teachers teaching to the^ tests (especially 
achievement tests)^ rather than teaching what they are ^supposed to. If such 
practice became, widespread, the. curriculum might suffer. Proponents of 
discldiiure counter this point by arguing that the legislation is intended to 
prevent such abuses by making available more information about the 
limitations of the testS- 

A related worry is that widespread availability of test items will be a boot; to 
expensive test cf)aching schools. Already a resource beyond the reach of poor 
student!?, theses^schools will confer an even greater advantage to the affluent. 
Supporters of disclosure claim the' opposite potential effect: that item 
availability will benefit the poor students by giving them materials once only 
available ih coaching schools. » ♦ 
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To the extent that disclosure will require test companies to prepare more new 
tests than they now do, and to the extent that thfe increased costs of this 
deyelophient will be passed on to studente, .costs of the ^tests will almost 
certainly rise, test publishers argue. Incr^ed costs will discriminate against the 
poor students' Advocates of disclosure dispute both the amount of new 
material that wolild be required and the costs that must be passed on, but thej^ 
ate handicapped by a lack of hard data on . these matters. Estimates of tWr 
amount of new material already in each test edition range from 10 percent to 
80 percent; estimates of additional cost have ranged from $.32 per student on 
the SAT test to $25 per student on the MCAT test. Much depends upon the 
number of students available to share the cost burden. Obviously^ tests given to 
smaller numbers of students — mostly professional schoql tes^s^ will not 
generate the economies of scale that the SAT -can generate, prompting some 
critics of testing to complain that disclosure will only, ironically, niake the rich 
testing companies richer! As of this writing, the cost of the SAT has been ra|t|ed 
from $8.25 to $10. In addition, students who request their answer sheets, t?st 
questions and correct answers will be charged $4^65. 

Viewed from an ethical perspective, the actual cost is not a^ufficient pbjection. 
In p^rt because they have come to this realization, opponents of disclosure 
have deemphasized the cost argument in recent months. Whereas in the New 
York debate it was a primary objection, it is now considered a troublesome^ut 
solvable secondary problem. 



Increased Costs? 



Pro^s — Costs 
Needn *t Rise l^uch 



C. Technical Consequences and Their Long- Range Impact 

Opponents of disclosure have argued that it would breach the -security of the 
test* thereby diminishing their quality and utility. Security is necessary, they 
argue, in order to ensure that some students do not have unfair advantage over 
others; to equate tests over time; to maximiz^e th^ lifespan of time-tested, 
unbiased * items; to meet students' and institutions' demands for flexible 
administration schedules; and to^^eep development coats as low as possible. • 



Technical 
Consequences 
''and Impact 

Testers Argue 
Lower Validity 
and Use If 
Security is 
Breached 



The points' are coiinected, opponents of disclosure argue. For instanceyif some 
students knoV what is on the test, the test is no longer a valid indicator of 
ability. The omy way to make sure that does not happen is to give a ne^w. test 
every tim^. If one does that, the new tests are likely to suffer from hasty 
development or else use items from old tests. In either case, they will be lower 
in quality and less valid. If they are lower in quality or less valid or 
admijiistered to larger groups, difficulties will arise making one test comparable 
to another, further eroding validity. Some tests are equatedjjy using all or most 
of the itertis in the test. Although the laj/s allow for equating procedures that 
employ only a^w items, they do. not allow for tbis *spiralling'*approach to 
comparability (employed by the GRE Aptitude Test, for instance). The result 
of poorly equated tests, test makers argue, would be decreasing confidence in 
the tests by^ admissions officers. At fts most extreme, ^his loss of confidence 
could hurt students who would be overlooked for admissions were it not for 
their high scores on tests. 

Proponents of disclosure argue that there are two ways of insuring the benefits 
of security. One is t^o what the testers have^o far done, but the othei^is to 
do just the opposite: create a. pool of items so huge that no one ^ould hope to 
study for more than a fraction of them. Although it might tatoi years to 
accomplish, every test wouldJSventuafly consist items drawn from the pool 
in^^way that assured equivalence from test to test. If, in addition, each. test 
consisted of some items that cannot be memorized essay questions, for 



Pro 's A rgue 
Security Not 
Vital to Validity 

Alternaty}es to 
Security ' " 
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Medical Colleges 
File Injunction 



instance, of various kinds of brav^ing items the validity need not suffer. 
Instead, face validity could well improve.-Some proponents of open testing 
think that traditional security is a dinosaur anyway • Pointing to current trends^ 
ih individualized instruction, diagnostic testing, tailored testing, criterion and 
objectives^feJerenced testing, creativity and problem solving tests and develop- 
ments in latent-trait theory, they see a future in which the traditional 
paper-and-pencil tests are .used less and less* Futurists among them even suggest 
that cheap, widely 'available information handling technology will soon drive 
out the old modes of testing altogether. 

Opponents of disclosure are not so sanguine about these largely untested 
suggestions, because they know too well the complex problems encountered id 
validating any system, secure or open. Nor have they b§en given years to creatf 
a new foundation for test validation* Nevertheless, most testers no longer take 
the hard line on the technical security issues that they togk during the New 
York hearings. Individuals in the testing community are letting it be known 
^ that they now find the validity problem ^^challengi^^^nstead 6f **impossible.'' 

One exception to this, however, is the Association* of American Medical 
Colleges (AAMC), which has obtained a temporary injunction against the New 
York law until the case can be argued that, among other things (see Chapter 
IV), the disclosure provision would cause them *^eparable injury.'' They \ 
argue that disclosure of the^edical College Admissions Test (MCAT) forms, 
questions and related studies will destroy their value, because (1) the AAMO 
will no longer be able to assure ex/u^iinees that they will have uniform access to 
the test questions; (2) disclosure of stimulus materials ^passages, graphs, tables, 
' etc.) will destroy other, as yet unused, questions- that could be asked about the 
stimulus; (3) continued disclosure will exhaust the number of acceptable 
quesiAns that can be generated for the science subtests (which are strictly 
limited in subject matter, by design); (4) disclosure will irreparably harm 
comparability studies that equate each test to previous tests; (5) disclosure will 
reveal the placement of nonscored, experimental questions, leading some 
examinees to ignore them; (6) release of MCAT results is more or less 
continuous; (7) disclosure of MCAT -delated studies will reveaf potential and 
actual test questions; and (8) disclosure of studies i>eculiar to individual 
institutions will force AAMO to breach its promises of confidentiality to those 
institutions. - . • 



Worry Remains 
About Test 
Development 



Maximizing the lifetime of good items remains a nagging concern. Everyone 
who has developed a' test knows how difficult and time consuming it is to 
create itemK that dp what they are supposed to do and are relatively unbiased 
at the same\time. Some representatives of minority groups testified against 
disclosure on these grounds alone. They, were afraid that a proliferation of test 
items wopld increase the probability that^ulturally biased itepis>yould appear 
more often, offsetting steady progress toward minimizing them over the last 10 
years. Prod^closure people agree- that this could be a problejii, but they do not 
think it is beyond solution. • . 



Less Klexible 
Administrative 
Schedule Results 



The security issu^does affect ^the number of times tests will be administered. 
There is currently considerable flexibility ;n administration dates, make-up 
dates, and prc\vision Jot Sabbath observers and handicapped students. This 
flexibility is due largely ^o the fact that tests are secure. Test companies argue 
that — at least for the immediate future — the loss of security will require fewer 
adminis|.rations of the teits. That this cutback will indeed adversely affect 
individuals or the quality of the administrations remains to be seen. y 

Most recently, testing spokesijien have suggested that, although they might be 



ERIC 



30 



V 



52 



al^le to deal with the immediate problems of disclosure^ they are uncertain 
about the consequence^ of many, many disclosures accumulating over a long 
period of time/ Presumably, this conflbm is related to their concern that 
admissions officers will Jose confidence in the t^sts as predictors of success in 
higher education. Any such loss of confidence is likely not only to further 
reduce the testes predictive validity but also to work against already 
disadvantaged students. Far too often, they fear, a student from an unknown 
school or with a mediocre academic background will be turned down because 
the admissions officer did not trust his or her test score. « 
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IV. LEGAL IMPLICATIONS OF OPEN-TESTING LEGISCATION* 

As various **open-testing'' bills are introduced and debated at the Inderal and 
state levels, legislators are increasingly cautioned about the potential illegality 
of these bills. - 



Open-Testing 
Legislation: 
Legal or Illegal? 



At the federal level, Congress is told that federal open-testing legislation w^uFd 
violate various provisions of constitutional and statutory law. The Tenth) 

'Amendment of the U.S. Constitution is cited because it reserves undelegated 
powers to the. ^tates, and education traditionally » has been primarily a state 
responsibility. The First Amendment is cited because it arguably protects both . 
the right of. colleges to determine who shall be .taught, and the righi of 
researchers hot to disclose the results of their research regarding tests>Jrhe due 

.process clauses, of the Fifth and Fourteenth Amendments are cited because 
they prohibit depriving any person of property (tests) without due process of 
law; The Federal Copyright Act is cited because it arguably protects 
proprietary rights in the tests. The protection arguably granted these tests by 
the Freedom of Information Act (exemptions) is also cited. 



Federal Level 



- Similar, arguments are advanced in state legislatures. In New York, which has 
passed the strongest open-testing legislatiop as of this writing, the arguments 
are also being advanced ki the courts. The Association of American Medical 
Colleges (AAMC) has challenged the New York legislation in federal court, 
•relying primarily upon the due fHrdcess and copyright arguments.^ Another 
legal challenge has been filed by the College l^ntrance Examination Board 
(C^IEB) against administrative interpretations of the New York law that affect 
tests that have been taken outside but used inside New York State. ^ 



State Level 



It is not possible in this chapter to discuss even in summary form all of the legal 
issues raised by these various claims. Each legal claim needs tp be considered 
in relation to the exact open-testing laW involved and analogous case law, and 
these in turn need to be applied to the specific factual situation raised by^the 
claim, for example, the particular open-testing law (the scope of regulation, 
the degree of control, etc.), the particular test (low volume, high volume, etc.), 
the particular use of the test (college admission, professional certification, high 
school diploma, etc.), the status of the claimant (private profit-making 
company, private nonprofit company, educational ijistitution, etc.), and the 
harm asserted by the claimant (economic, educational, etc.) could all influence 
the outcome of a given case. 

It ^ill probably take years for the courts to resolve all df these issues, especially 
given the inevitable questions involved in interpreting and applying the exact 
language of any new law to specific factual situations. But it is possible and 
may be helpful to discuss in broad outline some of the more basic 
constitutional and statutory claims, and these will be considered under the 
following headings: .(1) Legal Packground, (2) Tenth Amendment, (3) First 
Amendment, (4) Du0 Process, (5) Copyright Act, (6) Extraterritorial Issues, (7) 
Freedom of Information, (8) Other Implications and (9) Conclusion. 



^This chapter was prepared by Merle Steven McClung, director of the Education Commis- 
sfon of the States' LaWahcJ Education Center. The footnotes appear at the end of the chapter. 
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1. Legql BackgrjDund ^ 

In considering opeh-testing or any proposed legislation, Congress and state 
legislators ^ust of course legislate within the parameters' of the U.S. 
Constitution, as interpreted by the U.S. Supreme Coart. In addition, legislation 
passed by state legiMatures must be consistent with federal statutorjf^w and 
tKeir own state constitutions! Therefore legislators, with the assistance qf their 
legal counsel, should, make some assessment of the validity of the ^bove legal 
arguments before passing open-testing legislation. Th^ following discussion can 
help in making this assessment but additional analysis will be necessary for 
reasons mentioned above. ^ 



The constitutional issues and some statutory claims will be'evaluited by Courts 
in part by balancing the* state (fedetgl) Interest in J^egulaljmg tests with the 
claimant's interests. The state's primary ar^ment will probaj^y be based ^pon 
the public interest in' providing irtformation about the instruments used in 
making ^portant ^e^f^ational and occupational sorting decisions about its 
citizens/ Proponents of open-testing legislation would probably also point to 
analogovft precedent for regulation requiring disclosure of information such as 
the Securities and Exchange Act and various acts regulating the food and drug 
industries. . ■ ^ . . 

Opponelnte of open-testing legislation, on the other hand, will probably argue 
that' test security is essential to 'test*validity, and that disclosure will hurt more 
Students than it b^lps. testing* companies will also allege infringement of 
proprietary rights in their tests^ These and>pther arguments for and against 
open-testing legislation are set forth else\vhere in this.report. 



Since open-testing legislation^ is a new phenomepcm, there is no case law 
directly balancing the equities and setting, /he . l^al pframeters of . such 
legislation. Related issues h^e been "'ciShsider^d in a case v\/tjere the U.S. 
Supreme Court balanced the equities arising under the National Labor 
Relations Act. In Detroit Edison Company v. National Labor Relations Board,^ 
the Siiprenpie' Court overturned an NLRB order f^uiring Detroit Edison 
Company to disclose test, questions and answer shpets that were used in an 
aptitude testingnprogram under which some union eijiployees^had been rejected 
for certain job openings. ' • . 

The Supreme Court's decision in Detroit Edison^ has been cited • by \sonie 
opponents of open-testing legislation as a legal bar to such legislation^^^^iJTiis is 
certakily a misreading of the case since an^^coiyrt would find manjMmportant 
distinctions between the Detroit Edison case and open-testin^egislatibn, 
^mong these distinctions are the faqts that Detroit Edison involved specific 
pravisions of the National Labor Relations Act, aptitude tests used for 
employment purposes, j^nd disclosure -that infringed upon the privacy interests 
of the test takers. Any *oii all oX these facts could be used to distinguish the 
Detroit Edison^'^ase from the kind of open-testing legislation considered in this 
report. In sum, the Detroit Ejissn case does not present a legal bar t6 
open-testitY^ legislation. ' / 

The Court's decision in Detroit Edison nevertheless may be of some interest to 
legislators since the Court was involved in balancing the. conflicting legitimate 
interests of the unibn, individual Employees, the employer and the test 
companies. Writing for the- majority. Justice Stewart note(^: **Test secrecy is 
concededly critical, to th6 validity of any such program and, confidentiality ^of 
scores*i€^tf^5niably important to^the examinees.''^ 
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Th6 exjulties and ultimate batehce reached by the Co^rt might hav? shifted in 
this' case if the examinees h^ requested rather than refused cliscbsure of the 
tes^ questions and correcfted answer sheets; The Courts conclusion that test 
. seciHjity was critical to the validity of this employee tesUil^ program provides 
some support for those arguing that test security is essemial to the validity of 
other kinds of testing 'progr&jns, but this support il lim^d because ''[t] hrough- 
out .this proceeding, the^reason^bleness of the Company's co^j^ern for test 
(^ectecy has been e^entiwly (fonced^."^ As noted elsewhere in this report, 
. pfoponerits of open-testing do not cOTcede that test security is essential to test 
' Validity' The qu^stiop of lyhethdl or not test security is-essential to test validity 
is one of the key factual issues that legislators, and perhaps ultimately the 
courts, will have to rei^Jve in considering open-testing legislation. 



\. Th 



2. The Tenth Amendmeclt ' r 

( 

The Tenth Amendment to the U.S. Constitution provides: **The powers not 
^legated to the United States by the Constitution, nor prohibited by it to the 
states, are reserved to the states respectively, or. to the people." Since education 
is not specifically mentioned ilh the Constitution, education has traditionally 
been seen as primarily a state responsibility. 

The Tenth Amendmenjj^ lAwever, h^iajiever" been interpreted to give the states 
exclusive control over education, "Congress has passed many laws affecting 
y education, with laws designed to protect the civil rights of students being a 
primary €oncerru Title VI oj the CiviJ Rights Act of >964 (racial discrimina- 
^ ^ ^ionjfTitle of tlie ^Education Aniendments of 19%2 (sex d^crimir^ation), 
' Section 504 of the I^ehafeijUtation Acl of 1973 (har^dicJ^ped ^%j;rimiQai.ion), 
and the Family Educational Rights and-^jPrivacy Act of *1974 (student records)^ 
are*x)b<^ious examples. Since testing involves4he 'sorting of students and other 
citizens for various educational and occupational opportunities, with special 
inlplications ror minorities and other^tfotected-^nroups, the federal government, 
could claim a similar If gal interest in opeh -testing legislation. 

I ' . . • . . \ 

• * In sum, open-testing legislation wpuld not appear stffficiently different from 
other federal legislation affecting education to raise serious questions under the 
Tenth Amendment. Since the argument based on the Tienth Amendment raise* 
questions about the authority of the federal government over educat^n^ 
masters, it obviously rtbses no legal questions for state open-testing legislation. 

* ■ ■ . ■ < ■ 

3, The First Aijiendment ' 

Another constitutional claim, is that open-testing legislation infringes on First 
Amendment liberties in two ways: first, the legislation infringes up(;jn^a college 
* " ' or university's right to determine who is taught} and second, such legislation 
infringes upon a private individual's right to determine whether or not his or 
her research on a test will be made public. 

As to the first claim, it is not obvious that there is a connection between 
open-testing legislation and who is taught. Does the requirement to disclose test 
information in effect mean that the state determines - who is taught? 
Open-testing proponeats will probably argue that there is little factual basis for 
equating disclosure with selection, and the burden of establishing this^actual 
basis would fall ilpon the opponents. Few would disagree, however, that legal 
disclosure might raise policy questions about selection criteria. 

Other existing laws more directly affect the right to determine who is taught. 
For example, there are some nondiscrimination limitations on the admissions 
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process that private and public universities agree to accept as ^ condition to 
receiving federal funds. Consider also the Supreme Court's .decision in 
University of California Regents v. Bakke^^ which outlines the legal-parameters 
for affirmative action programs in the postsecondaiy admissions process. 

Two important factors in determining whether ppen-testihg legislation uncon- . 
stitutionally forceps a researcher to disclose research data about a test would be 
(1) whether the researcher was employed by or had Contracted with the test 
company, and (2) whether the test company used the research as the basis for 
validating and/or publicizing the test. If the researcher was employed by a test 
company to do the research on the test, and the test company used the 
research as the basis for validating and/or publicizing the test, then tlTe-^-L^ 
argument in favor of a First Amendment right of the researcher not to disclose 
the research data would appear weak. On the other hand, if the test was not 
based in some way on the research and the researcher had no financial > 
relationship with the test company, the argument in favor of a First 
Amendment right of the researcher not to disclose would appear strong. 

In sum, the First Amendment issues would not appear to present a major 
obstacle to open-testiqg legislation, but such legislation could infringe upon the 
First Amendment rights of some individual researchers unless carefully drafted 
to avoid this potential problem, 

4. Due Process 

The due process clause of the Fourteenth Arnendment provides that no state 
shjpill '^eprive any. person of life, liberty, or property, without due process of 
law."^he\^e process clause of the Fifth Amendment is joined by another 
prohibilion^^'nor shall private property be taken ih^r public use, without just 
compensation." ' \ ^ 

' The claim is that open-testing legislation deprives testing compaTiies of private 
property (the test and test data) without due process of law atfid without just 

, compensation. The claim of private property interests in the tests is buttressed 
by their copyrighted status under the Federal Copyright Act. 

* Proponents of open-testing legislation will probably argue that test companies 
are not deprived of private property by such legislation because it requires only 
disclosure of information, and does not involve depriving tli^ companies of 
legal ownership of^the tests. In response, the test companies willf^obably argue 
that disclosure in effect deprives them of private property for two reasons: 
competitor companies unfairly reap the benefits of their private research, and 
disclosure of test questions and answers destroys their value for future use. The 
strength t)f this response will depend in large part upon the extent to which 
copyright law and other factors protect test companies' research against ^ 
competitive emulation (compare with disclosure requirements for new food 
and dnjg products), and the extent to wl?ich test companies are able to pass on 
the increased cost of developing new test items to test takers (as discussed 
elsewhere in this report). 

\The argument claiming deprivation of private property is stronger where'Hhe 
test company is not a nonprofit organization. This argument will also be 
sttrongdr where proprietary rights in the test have been established under 
copyright law (see copyright section below). Proponents of open-testing 
legislation, on the other hand, will probably raise questions about how 
''private" tests developed with the tax benefits of nonprofit status can be. 
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Assuming thai telt companies will prevail with thoir argument that disclosure is 
Equivalent toV^privation of the test, and thaf the test is private property * 
within the meanmg of Constitutional provisions, a second and perhaps stronger * 
y argument likely to be advanced by the proponents of open-testing legislation is 
that tjl^^'^eilislation does not force test companies to disclose test information. 
The legislative requirement is a conditional one, forcing disclosure only il the 
* test companies want to use the test within the state. This argument would raise 
the question of whether test companies' access to studertts and other citizens 
within a state is a privilege that can be granted by the state or a private right 
||jiat states cannot control. 

Reviewing the judicial history of the **just compensation" clause of the Fifth 
< Amendment in Penn Central Transp, Co. v. New Yorky^ the U.S. Supreme 
Court noted that it had been unable to develop any **set formula" for 
determining when ''justice and fairness" require that economic injuries caused 
by public action be compensated iDy the govemmen^, and that resolution will 
depefid largely upon the particular circumstances of each case: 

In engaging in these essentially ad hoc, factual inquiries, the -Court's 
decisions have identified several factors thafhav^ particdfar signifi- 
cance. The Economic impact of the regulation^ o^^the claimant and, 
particularly i the extent lo which the regulation has interfered with 
distinct investment-backed expectations are, of course, relevant 
considerations. See Goldblatt v, Hempstead, [369 U.S. 590, 594 
, (1962)]. So, too, is the character of the governmental action. A 
"taking" may more readily be found when the interfererice with 
property can be ciliar.acterized as a, physical invasion by government. 
See, e.g., Vnited States v. Causby, :32S U.S. 256 (1946^, then when 
interference arises from some public program adjusting the benefits 
and burdens of economic life* to promote the common good. 

**Govemment hardly could go on if to som^xtent values incident to 
property could not be diminished without paying for every such 
change in the general law," Pennsylvariifl Coal Co. v. Mahon, 260 
U.S. 393, ^y^(1922), and this Court has accordingly recognized, in a 
wide varie^Hof contexts, that government' may execute laws or 
programs that adversely affect recognized economic values.^ ^ 

These factors indicate a difficult stanc^ard for test companies to meet if they 
are to prevail on a "just compensation" claim. 

Although a remedy pursuant to a successful claim of deprivation of private 
• ' property ''without just compensation" could be substantial, test companies 
probably \Vould not be satisfied by the likely remedy for a successful due 
proc6ss claim since it would only provide a right to procedural due process 
before deprivation rather than a substantive prohibition against that depriva- 
tion. A successful due process claim would raise the question of what kind of 
procedural hearing is required and whether it had been provided. 

The due process clause has a substantive as well as procedural impact in $ome 
situations. The legal standard applied in modern substantive due process cases is 
usually not carefully set oilt, but state action is usually illegal if it (1) is 
arbitrary or capricious, (2) does not achieve any legitimate state interests, (3) 
frustrates. any legitimate interest the state might have or (4) is fundamentally 
^ unfair. Whatever the exact wording of the legal standard, test companies and 
H other opponents of open-testing would find it difficult to estaWish a 
substantive due process violation since the general standard is that state action 
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cannot be unreasonable^ with uhreasdhableness being construed narrowly (e*g,, 
rational persons would not disagree),^ ^ 



5, Copyright Act ^ 

A new federal Copyright Act,^ ^ passed in 1976 and effective as of Jahuary 1, 
1978, provides for a single system of statutory protectionsfor all copyrightable 
works* The new uniform system encompasses prior copyrighted material, 
generally protects works for life-plus-50 or 76/100 year terms, and provides for 
five classes^of copyrightable material including a broad category (Class TX) for 
nondramatic lijterary works. The law also recognizes the principle of "fair use*' 
as a limitation on the exclusive rights of copyright owners^ and indicates factors 
to be considered in determining whether particular juses fall within this 
category • * • 

Test companies claim that the copyright law estatJltsIies proprietary rights in 
their tests that are infringed by open-testing legislation^ reljuiring disclosure of 
test items (questions and answers) and related test data. For example, the 
AAMC in Association of American Medical Colleges.v. Carey^ ^ claims that the 
Medical College Admissions Test (MCAT) forms and studies "are Copyrightable 
under the federal Copyright Act of 1976, 17 U.S.C. Sec. I02(a):*^'* The 
AAMC points to specific provisions in,^4ii^ Copyright law that recognize 
inclusion of secure tests by providing a definition of "secure test** (37'C.F.R» 
Sec. 202.20(b) (4)) and deposit requirements iter secure tests (37 C.F.R. Sec. 
202.20(c)(2)(vi)). The AAMC alleges that they have complied with all 
requirements of the Copyright Act and therefore have "... secured the 
exclusive rights and privileges in and to the copyright of all ^:C.A.T. test forms 
and studies, including the exclusive rights *to do and to authorize,* inter alia, 
.the reproduction, distribution, and public display of these documents pursuant 
to^l U.S.C. Sec, 106(1), (3), and (5).**^ ^ 

Therefore the AAMC claims that Sections 341 and 342 of the New York Act 
will compel them to reproduce, distribute and display their test forms and 
studies ih conflict wit^h "the exclusive rights granted to plaintiff under the 
federal Copyright Act .... Accordingly, Sections/341 and 342v are preempted 
under the 'Stipremacy Clause of the United States Constitution, Article VI, 
Section 2.'*^*^ In a separate count the AAMC/ claims that the New York law 
also violates 17 U.S.C. Sec. 201(e) which m^vides that unless transferred by 
the individual author, "no action by any^j|0vernmental body or oth^ official or 
orpinization purporting to seize, expropriate, transfer, or exercise rights of 
oA^ership with respect to the copyright, or ahy of the ^xclusive rights under a 
copyright, shall be given effect under t|iis title. ^ V 

The New York defendants have not filed an answer^'to the AAMC complaint as 
of this writing,^® but defendants in this kind of case are likely to raise 
questions about whether the specific test is covered by the Copyright Act, and 
,argue that the* disclosure required by their open-testing law falls within the fair 
use provisions of the Copyright Act. Section 10? of the Copyright Act provides 
that the fair use of a copyrighted work is not an infringement of copyright: 

In determining whether the use made of a work in any particular 
case is a fair use, the factors to be considered shall inqlude: 

ft 

(1) the purpose an^ character of the use, including whether such 
use is of a . commercial nature or is for nonprofit^lucatiOTial 
pt^poses; ^ \/ 

(2) the nature of the copyrighted work; 
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(3) the amount- and substantiality of the portion used in relation to 
the copyrighted work as a whole; and, 

(4) the effect of the use upon the potential market for or value of 
the copyrighted work.^ ^ 

In a historical note to this section of the law, the U.S. House of Representatives * 
Committee on the Judiciary (House Report No. 94-1476) states that the above 
four .standards provide ''some gauge for balancing the equities, "^^ The 
Committee also notes: ^'Although the courts have considered and ruled upon 
the fair use doctrine over and over again, no real definition of the concept has 
ever emerged. Indeed, since the doctrine is an equitable rule of reason, nXS 
generally applicable definition is possible, and^ .each case raising the question 
mifl|^^be decided on its own facts. ^ In stressing the need for a case-by-case 
balancing of the equities, defendants will probably ^so raise the broader 
question ^ of whether the Act was intended to preempt a state's authority to 
regulate tests that affect its educational institutions and students. 

A more basic issue underlies all of the specific statutory claims that will be 
raised by plaintiffs and defendants in this kind of litigation. Testing companies 
(plaintiffs) are likely to argue that disclosure is compelled by open-testing 
legislation, and states (defendants) are likely to argue that disclosure is required 
only if plain^ffs want to use the tests within their states. Tlfl^the courts will 
be faced with an initial question of whether disclosure is a requireme>it of the 
particular open-testing law in question or whether disclosure is simply a 
condition of access to a market. And if conditional, do property rights 
estahUshed under the Copyright Act create any legal bar to the state's authority 
to create such a condition? 

In* sum, the copyright claim raises, many unaitswered questions, and further 
research in tlys area is in order. Many of these questions may be answered in 
the near future by the federal court's- rulings in the AAMC challenge to'tkie 
New Yoijk open-testing law, 

6, Extraterritorial Issues . ■ ' ' 

On Octobefll^ 1979, tlTe New York Commissioner of Education provided an 
initial rep(»^ffl the meaning and application of the New Yprk open-testing 
. law. The report stated that ''the Law applies to any test . . "Whether the test is 
administered in New' York State or the results of the mt are provided to 
institutions located within^ the State. ''^ 2 

This '^extraterritorial" interpretation of the New York law has been challenged ' 
by CEEB in College Entrance Examination Board u. Abragis.'^^ CEEB alleges 
that interpreting the lawvto include. the results of a test administered outside 
New York State. but provided to institutions located within the state is an 
attempt on the part of New York to exefcise extraterritorial jurisdiction 
prohibited by, inter alia, the commerce clause, the due process clause, and the^. 
f. full faith and credit clause of the United States Constitution.^ ^ 

CEEB claims that among the^xtra territorial effects of the-law ai^: 

(1) CPEB would be| required to disclose virtually all S.A.T. test 
questions used in test administrations, including questions used 
solely in tests administered outside of New York. 

(2) would be required to prov1^||uil students regis «ringto 
■ take the S.A.T. all of the informatjPr required by Sec! 343(Y) 

of the Law because it would have no way of knowinj? in 
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Stdvance whether ft test score from an Qut-of-st^te test adminis- 
. J tralion wov^d, fii some later /time, be sent to a New York 
institution. ' ' 

(3) CEEB could no longer send score reports of Connecticut, 
Indiana and Pennsylvania seniors to their state's scholarship \ 
program without the qtudent*^ specific authorization. 

(4) Because the Law requires public filing of all studies and repprts 
pertaining to fiftandardized tests, the College Boai:d would haye 
to file "reports it prepares for institutipns located outside New 
York. Since reports often contain confidential information 
relating to these institutions, piany out-of-state institutions, 
would probably choose 'to discontinue their use of this College 
Board service.^ ^ ^ 

■J ' ■ 

No answer to t\\e CEEB complaint haS- been filed by defendants as of this 
writing. A number of responses are possible. One response might be that, the 
New York law is)*iot in tended^ to have the extraterritorial reach cited by CEEB, 
no official state interpretation to this effect has been or will be made, and 
therefore the CEEB claim presents no case or controversy for the court to 
decJl^ An alternative responsa might concede an extraterritorial effect of the 
law^But dispute thaixtent of tl^at effect and/or contend that the extraterritor- 
ial effect does not^substaptially impede interstate commerce and thus is within 
New York's police power to regulate tests that affect its local educational 
institutions and students. 

The general rule in determining undue burden on interstate commerce is stated 
by the U.S. Supreme Court in Southern Pacific Co. v. Arizona:^ ^ 

When the regulation of matters of local concern is local in character 
and effect, and its impact on the national commerce does not 
seriously interfere with its operation V. . such regulation has been 

generally held to be within state ajjJthority But . . . the states 

have not been deemed to have authority to impede substantially the 
free flow of commferce from state to state .... (emphasis added). ^ ^ 

Factual evidence of the extent of the extraterritorial impact of the New York 
law and legal definition of the terms /*seriously"^d **substantially^' would be 
central in applying this gener^aile. 

Like the AAMC complaint, the College Board's complaint raises legal issues too 
diverse and complex to be discussed in detail in this report. Perhaps more 
important ta legislators is the fact that, unlike the AAMC complaint, the CEEB 
complaint does not question* the authority of a state to enact open-testing 
legislation, only the extraterritorial interpretatj^on and'effect of that legislation. 
Therefore the CEEB caset and subsequent decision will be of greatest interest to 
state legislators who are considering open-testing legislatibn that may have a- 
substantial extraterritorial effect. ' ^ 

7. Freedom of Information Statutes 

<^ 

Most freedom of information statutes apply only to public agencies and include 
numerous exemptions that have the effect of excluding test items from 
disclosure requirements.^ ® The key data regarding validity studies of tests, and 
test questions with answer sheets, are usually not given to public schools or 
other public agencies by the testing companies. As a result, the testing 
information that can be acquired through rhost freotlom of information laws is 
very limited. Open-testing proponents of course argue that the testing 
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companies themselves, Especially those wi% "nonprofit tax status, ar6 quasi- > 
.public agencies, and should be treated liK^ublic agencies for purposes of 
disclosure'. - 

Open-testing opponent's cite freedom of ihformation statutes as evidence^f * 
legislative' intent to omit testing companies fr<jm full disclosure. Proponents 
argue that such an inference is questionable and that even if valid dpeOiot 
legally preclude the kind of change in legislative intent that they advocate. In 
any case, freedom of information statutes do. hot provide a strong legal basis 
for either the proponents or the opponents of disclosure of this kind of test 
information. 

Postscript Freedom of information statutes of course provide access to some 
testing information, depending upon the state and the exact statutory language 
involved • For example; a New Jersey Superior Court held that parents have a 
right under the New Jersey Right-to -Know Law to inspect computerized 
system wide, grade-by -grade results of a standardized testing program adminis- 
tered in public schools.^ ^ But this holding did not extend to a right to access 
to test questions and answers. Similarly, students do not have access to test 
items and related test data pursuant to the ^'Family Educational Rights and 
, Privacy Act'' (FERPA) (the '^Buckley amendment") since education agencies 
usually are not provided with this cUtta by the test companies. If educational 
agencies did have this data, disclosure under FERPA would be limited on an 
individual basis to personally identifiable data related to the test. 

Students have legal access to test items and related data in some limited 
situations, primarily where they and a court need the information determine 
possible violation of civil rights. For example, the federal district court in 
Debra P, v. Turlington^ ordered test items and related test data to* be made 
available to the plaintiffs in order to determine the validity of their claims that 
the Florida competency testing program violated various 'rights guaranteed 
them under the Constitution and federal law. The protective order was limited 
to the plaintiffs, their attorneys and experts, who were in turn prohibited from 
disciosure of the data beyond that defined group. Similarly, a handicap^)ed 
student would have a strong* legal claim, under the Education for Handicapped 
Children Act of 1975 and under the Fourteenth Amendment, to accefss to this 
kind of test data in order to determine the validity of an educational 
classification based upon th6 results of a standardized t^tf This would also 'be a 
limited disclosure based upon individual rights and would probably require a 
court order. We are not aware of any case where a student in a postsecondary 
^education institution has established a legal right to access to test items and 
related data. 



8. Other Implications 

Open-testing legislation, at the federal- or state level, is likely to lead tQtwo 
further "legaP' developments worth noting: onAjJegislative and one litigatiV^ 
Proponents of open-testing legislation would ptDba^)ly see both as positive 
developments, and opponents would probably take the opposite view. \ 

If open -testing legislation in its present form survives its legislative, legal and 
practical effects tests, one likely ^evelopmefft is ex'pansion of the legislation to 
include (^^W forms of testing. Current legislation is limited to postsecondarj^ 
and professional admissiona tests, vfrith some *Mow volume'' tests' being 
exempted. .The equal protection arguments raised against such^ exemptions*^ ^ 
inadvertently form the policy basis for their subsequent inclusion, although the 
legislative classification based upon low /high volume tests would appear to 
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meet the legal standard of rational relatiopfihip to a legitimate state purpose. As. 
noted elsewhere in this report^ the Gibbons^bill would, also encompass many 
employment tests. 

Other forms of testing4)robably have as strong or even stronger policy bases for 
s^in^usion. For example, various forms of -secure certification tests are used as 
th^ predominant and' even exclusive arbiters of competence. Consider, for 
example, bar examinations and medical boards. Consider also competency tests 
used as a prerequisite for a high fechool diploma. The rationale used by some* 
testing companies in opposing disclosure of aptitude tests would specifically 
exclude many Achievement tests like competency tests which are designed in 
part for instructional and remedial purposes.^ ^ The potential educational, 
economic and psychological injury of state certification of competence or 
incompetence based upon a single, secure, standardized test, was recently 
underscored by a federal court in Debra P. v. Turlington.^ ^ Intelligence 
Quc^fient (IQ) tests also vce used or misused in ways that have profound effects 
upon the life-chances of individual test takers. To say this is not to imply a 
legal basis for inclusion of other kinds of tests; only to suggest a strong policy 
basis for expanded legislation if there is a sounds policy basis for current 
open-testing legislation. 

A second development likely to follow open-testing legislation is litigation by 
test takers whq challenge the intrinsic validity of a particular test and/or the 
alleged misuse of a particular test. Current litigation, based in large part updh 
court-ordered disclosure of secure standardized tests, is indicated by Dehffi P. y. 
Turlington, supra (competency tests) ^nd Larry P. v. Riles^"^ (IQ tests). 
Open-testing legislatiQn making it easier for scholars, test takers and lawyers to 
examine a particular t^st will also make it easier for them to challenge decisions 
based upon thosfe tests. Individual test items will probably receive greater 
scrutiny. Answers deemed correct by the s^thorities, for exan[ipl^, could be 
challenged by test takers who argue that one or more of l!he distractors is as 
good or an even better choice.^ Some suits of this kind would be dismissed by 
the courts as frivolous, but others would be heard if the test takers could show 
sufficient questionable items within a test that collectively made, an important 
difference in their scores and in their educational or occupational prospects. 

As with expanded legislation, proponents of open-testing would probably^ see 
this expanded litigation as a healthy development leading to more public 
information and scrutiny about and less misuse of standardized teits. Similarly, 
opponents of opea-t^sting would probably view this kind of litigation as 
further complicating important evaluation and certification functions. 

[q. Conclusion t ^ 



V^. tentative conclusion based upon the above discussion is that open-testing 
legislation is not prohibited by existing constitutional or statutory law. One 
exception to this gen^l conclusion might rest upon the copyright claim, as, 
exemplified by the AAMC case.^^ While not challenging the authority of a 
state to enact open-testing legislation, ,tht CEEB case should clarify the 
extraterritorial extent of that authority. Legal counsel to state legislatures will 
want to review the arguments as refined in forthcoming legal briefs in these 
cases, and with reference to the specific legal and factual situations it) their 
states. Some states may want to delay consideration of open-testing legislation 
until the legal p^ameters of their authority are clarified by decisions in these 
cases. ^ ' f 
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y. -INITIAL IMPACT OF FULL DISCLOSURE LEGISLATION 



^ i$ too soon to -gauge thq full impact of the New York law upon students, 
higher education in^titiitions and test companies. However^ we can make some 
general observations and list the specific actions that have taken place up to 
this moment, Ev^thing in, this chapter niust be considered tentative and 
subject to change. ■ ^.^ ' 



A. General 



The enactment of. a controversial Taw is always followed by an unstable period, 
during which ambiguities in the law are ironed out in the legislature or the 
courts, enforcement agencies struggle to prepare interpretive guidelines and 
^ everyone waits to see if their pro(>laecies will come true. No one" should be 
surprised if some members of the testing community exercise their right to 
lobby against further legislation, file suits or ask for clarification* This is a 
normal course of affairs. Nor should there be surprise if testing companies 
request niore time to adjust to the law.* Admissions testing has been operating 
in a certain way for half a century, so change is unlikely to take place 
overnight. " 



Periodt of 
Adjustment 



Situation^ Change 



B. Specific ^ 

As of January 1980, the following tests given in New York and subject to the 
iaw have been withdrawn by their sponsors; , 

Allied Health Entrance Examination 
Allied Health Professions Admission Test 
Aptitude for Practical Nursing Examination 
Xptitude Test for Allied Health Programs » 
Doppelt Mathematical Reasoning Test ^ 
Entrance Examination for Schools of Health-Related '^technologies 
^ Entrance Examination for Schools of Nursing 

Entrance Examination for Schools of Practical/Vocational Nursing 
Health Occupations Aptitude Examination 
* New Medical College Admission^p Test 

Miller Analogies Test - ^ 

Minnesota Engineering Analogies Test \ 
Nursing School Aptitude Examinatton 
Optometry College Admissions Test 
Pharmacy College Admissions Tests y • 

[\ Pre- Admission Assessment for Practical* Nursing 
Pre-Nursing and Guidance Examination 
Pruebas de Aptitud Academia (Spanish S.A.T.) 
Veterinary Aptitude Test 

.Two of these tests, sponsored by the National League f^r Nurses — the 
Pre- Admission Assessment for Practical Nursing and the Pre-Nursing and 
\ Guidance Examination may return to New York in the spring. Of the 
\ remaining tests, twejve are sponsored by the Psychological Corporation, three 

\ by the Psychological Services Bureau, one by the Amedcan Association of 



Impact in New York 
to Date 



Withdrawn Tests ^ 
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Tests Still 
Offered 



Impact on Test 
Administration 



Increased Costs 



Potential 
\ Changes in the 
Offing 
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Medical Colleges and one by the College Board. Mbfit of these tests are given to 
smaU numbers of students. If the legislation is amended to exempt tests taken 
by small numbers of students, some or all of these tests might return to New 
- York. As things stand, the sponsors of these tests feel thaJt they do not have a 
sufficient volume of i^st takers among whom to spread the costs of developing 
more forn^s of the tests.' 



' The tests that will continue to be offered in New York ar^: The American 
College Testing Assessment Program, the Dental Admission Test, the Graduate 
Record Examination,' the Graduate Management Admissions Test, the Law 
School Admissions Test, the Preliminary Scholastic Aptitude Test/National 
Merit Qualifying Test, the Scholastic Aptitude Tests and the Test of English as 
a Foreign Language. However, these tests will not be given as often as they have 
been. The College Board plans to cancel four of the eifeht planned 1980 
administrations, three of which are Sunday administrations provided for 
individuals who cannot take exams on 'Saturdays for reli^ous reasons. In 
addition, flexible services for the handicapped will be reduced and large print, 
braille and cassette versions of the tests will be reconsidered. The Graduate 
Record Examination will change its number of administrations from six to 
four, and the Law School Admissions Council has droppedN<;he number of 
administrations of the LSAT from four to three. At the mom^t, it appears 
that the cancellations of administrations hrt hardest at those students who 
cannot take tests on, Saturdayfrfor religious reasons. However, it is p oii^ible that 
an amendment to the law will exempt Sabbath tests, thus reinstating the^pni. 



\ 



A glance at the list of tests" withdrawn reveals that health professions are 
heavily affected. Scholarships based upon admissions test scores in Medicine 
might be unavailable to New York students until a new procedure for awarding 
then) is found. State Department of Education officials fear that adult 
applicants with dated, backgrounds and minority candidates from unknown 
school systems are most likely to suffer if the health professions no longer use 
the tests to select candidates. 



The College Board has announced an increase of $1.75 in the cost of the SAT. 
In addition, of course, students who request test companies to return the tests 
/ will have to pay .a surcharge for the service. ($4.65 for the SAT, $4 for the 
LSAT, $5.95 for the GMAT and $5.50 for the GRE). The additional cost will 
most likely hurt poorer students the most. 

New Yotk state medical schools have waived the requirement for the MCAT' 
scores, saying they were never decisive anyway as determiners of admission. 
^ However, New York students who wish to take the MCAT will have to leave 
the state in order to do so, unless the law is amended to exempt it. 

As noted earlier in the report, the Association of American Medical Colleges 
has challenged the legality of the law and the College Board has fil^ a claim 
asking for an injunction against th^ extraterritorial provisions of the law. The 
outcomes of these actions will clarify the situation somewhat. In addition, a 
number of amendm^u^s to the law are being considered that might change its 
immediate impact. ^"""^^^^ 

No one knows how colleges and universities will respond to the provision that 
test companies must file copies of all validity studies conducted for 
institutions. The most likely outcome is that they will no longer ask for such 
/studies or will ask ths^t the law be amended to allow anonymity for institutions. 
Should^ they curtail validity studies and evaluations of their admissions 
\ procedures, testing representatives fear that the consequent lessening of test 
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«core use will redound upon already disadvantageci applicants. At the moment 
there is some possibility that this provision of the law will be am6nded, as well, 

'Clearly, the New York situation is in so mu<lh flux that it is nbt possible yet to 
judge the impact of the legislation. Amendmentg are being proposed that could 
change the impact, considerably and the court decisions could alter the 
situation substantially. Legislators considering testing bills would do well to 
study the New York examp^^ carefully, paying special attention to upcoming 
amendments and reactions to them. \ 
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VI. strate6ies4pr evaluating the debate 

AND subjects FOR FURTHER STUDY 



Having " arrayed ^rgtiments for and against testing legislation, and having 
sketched^ potential" Jegal issues surrounding it, it is tjme to boil matters jiown- 
to essentials. What* ^e the* primary issues? What dfjta are av^able to help 
someone weigh the 'merits of varioup argumenta2_VV[h«r^ritical data are 
missmg, how might one gather the needed information? • ■ 

It has already been pointed out that when they are discussing many of the 
issues, the ppponeijj|S?^o not really engage one another. They proceed from 
different assumpti"s and they disagree about facte-, interpretations of the 
* factsy warrants for drawing cojiclusions from the facts and conclusions. 

^ The testimony also abounds ' v/ith assertions for which little evidence is 
*p ' produced and issues that do not bear upon the laws and bills under - ^ 
consideration. This lack of hard data and ^hese excesses of emotion about other 
matters are striking features of the debate. They are telltale sighs that the^' 
ostensible issue is, in part, a surrogate for b'theY; deeper, undeclar^ct' issues. 
Among • those are some fundamiental qtieStions about equal opplorkinfty, 
meritocracy, and elitism that 'have troubled \h}s country for generations. How 
do Americans get ahead and' what role do the schools play in helping them? 
Who is rnfiJking the decisions about whom, on what authority and with what 
eonsequencas? Today, tpst manufacturers are on the carpet because their 
products ^obviously play a role irTthe selection /sorti()g process. It would not be 
surprising if another institution is called to the carcet nejft, and, after^that, 
./ . ^more and. more institution^, 'until* aillswers to thofe fundamental questions 
become more apceptable. * ^ - ^ 



What Are the 
Primary Issues? 

The Needed Data? 



Lack of ^ 
Evidence/ Data 



The Deeper Issues 



X 



As impcytant gfi^it is to explore ;many of these greater issues, it would be ^ 
. d^arture froWthe intetitton of this report to pursue them. So, in the interests* 
^•orsimplificaticm,,but acknowledging that the subject Of testing legislation is 
tie^ to' soniefprofouhd sc^ciaj policy matters, we should eliminate the more, 
global, socigo/^rgum^ftti about Testing and theJTest *!Indu^try" frQ;n our list of 
primary ls&i!(fi&-*^e proposed and enacted legislation focuses on a relatively 
narrow ^r/na and a relatively Harrow range of a6<4^s within that arena. The 
merits of/ aijy spddfic piece of legislation should beetrsfliTatedJ^ terms of the^ 
degree toWiic'h^itl^ccurately characterizes, directly addresses amH*-most likely 
tb beneficially ^ff^clrttwa in higher Vacation (the arena 

addressed by1tn9t^|b^f the|egif^tetton) or in ©robentary and secondary education 
(the arena addressed Jj/;^^ Jersey Where, such legislation may lead 
or how it might fit into\ conspiracy to **kill the messenger" or **destroy 
testing'' or drive the *MittleV*;(s^^^^ competition jjf cover up structural 
inequities inherent in capitalism/SSiTsSues beside the immediate point. 

The remaking issues can be dividecj into those in whfcf) empirical evidence 
plays a primary* role and those resting. Upon principle, T?) the ^^xtent that 
regulatory legislation addresses a •concrete projprem* that cam be renrjedied 

"^legislatively, its pro^jonents must b^ble to produce Evidence of 'the problem 
and evidence that the law will correcl it! To ;the extent- that the legislation is 

.called for on a matter' of principle — say, the principle of **fairness'' or the 
principle that \*8un9hine'' statut^^hould be extended to cover this area — then 
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Global Issues 
* A side. Examine 
Primary Issues 



The Other Ihs 



the proponents need to persuade us that the importance of the principle 
overrides objections to its implemehiaiion and the spcial benefits outweigh 
costs. 



A. Evafuating Assertions About the Importance of Tests, 
Misuse and the Effects of Legislation 



o 

I* 



Evaluating the 
^Arguments 



I^eaving the New Jersey and Gibbons bills aside, for the moment, the arguments 
that rest more upon evidence than principle can be collapsed into three general 
propositions: (1) admissions tests seriously affect the life-chances of American 
students; (2) admissions tests are being mi8Used/mis.understood/misadvertised 
in ways that place some students at a disadvantage; and (3) testing legislation 
requiring full disclosure y^ill soften the influence of the tests upon life-chances 
and will help correct problems stemming from misuse. The first proposition 
must be substantially true in order for the second to be important enough to 
require the third. Principles aside, if all three are supportable propositions, 
testing legislatioa might make sense* If any of them is unsupportable,. testing 
Ijpgislation may not be necessary. 



Propositibn 1. Admissions tests seriously affect the life-chances of American students. 



Admissions Tests 
Affect 

Life-Chances 



^ow Seriously 



\ 



What Do Students 
Think? 



Do Some 
Admissions Tests 
Havh More Impact 
Than Others? 
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The/key term here is the relative word "seriously." Supporters of legislation 
haye argued that the tests play an important role in individuals' professional 
lives, but they have not specified how important. Are admissions tests as 
ip/)rtant as supporters of legislation assert? There are several ways tg find out. 

First, do students believe that, admissions tests heavily influence their 
life-chances? We know of po systefnatically gathered data about this. Anecdotal 
^ evidence, and the fact th6t student groups lobbied for legislation in. California 
and New York, would indicate that many students do perceive the tests as 
having important influences on their cafteers. But the apparent evidence that 
the vast majority of students go to their first-choice undergraduate institutions, 
and the apparent relaxation of admissions standards due to* lower enrollments, 
suggest that the influence is not particularly great, at least at the undergraduate 
level. It appears that as the. stakes get higher and the competition becomes 
more fierce ~ that is, at the professional schi^ol level — the tests become more 
important. 



This leads to a second clarifying question: Do soiAe admissions tests have more 
impact on lives than others? It certainly appears that in fields like medicine and 
law, where the number of schools and students is highly restricted, the 
consequences of low scores are bound to be more dramatic. Whereas almost no 
undergraduate students will fail to find some school ii> attend, a certain 
percen-tage of law or medical school applicants may find themselves shut -out 
of those fields entirely if they do poorly on the admissions tests. Certainly, 
some must be shut out because there is not enough roo;n for all appli(;^nts. It 
may be that some should be shut out. Perhaps many of them simply would not 
make g6od doctors or lawyers. The question is whether or not, for those people 
Who do not gain entrance to professional school, the admissions test was a 
major factor or only one of many factors. 

To really gauge the importance of the test, it might also be useful to ask what 
happens to people who apply to professional schools and are turned down. To 
be sure, if the decision to deny admission was unfair, there is no real 
compensation* It would nevertheless be useful to know whether the aspiring 
^medical doctor becomes, instead, a chemist. Turned down by the law schools,' 
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does the candidate go on to pursue a Ph.D, in history? What percentage of the 
rejected applicants continue to apply until they are^ finally selected? What 
happens to the rest? When all is said and done, h6w significantly did the test 
affect the life-chances of individuals who already have bfichelor's degrees and 
are motivated enough to want to go further? ^ . ^ 

A third question that might be asked is: Are some admissions tests used 
differently than others? If graduate and professional school tests have^ore 
impact, rt may be because th6 competition is so fierce or it may be because 
they us^ (or misuse) test scores differently. For instance, it may be that the 
people who make admission^ decisions for medical school are quite different in 
background, training and knowledgeability about testing than people who 
make .admissions decisions for jlursing schools, undergraduate institutions or 
law schools. 

If there were more information about student perceptions and degrees of test 
impact at various levels or in various fields, it would be easier to judge this issue. 
But one might be confusing test influence with some other, less obvious factors 
that influence life-chances. Even if students believe that the tests are 
influential, the students may be wrong; the tests may simply ''stand for" and 
legitimize some more po^^rerful, but fess visible, selecting device/There is ample 
evidence that socioeconomic factors have a profound influence' upon life- 
^chances. In order to more fully understand the impact of test scores one would 
want to know how they relate to those other factors. If test scores are clofely . 
related to socioecononiic selecting. factors, then they may not have much real 
influencejapon life-chances at all. 

Proposition 2. Admi$$ioh$ tests are being misused/misunderstood/misadvertised in ways that 
'place some students at a disadvantage. 

The search for support of this proposition should begin with distinctions 
between admissions tests at various levels, institutions and professional schools. 
Who makes the admissions decisions? What training have they h^d? What other 
criteria do they examine? The recent College Board-AACRAO Survey of 
Undergf'aduate Admissions Policies, Practices and Procedures (Van Dusen, 
1979), provides, some useful information about the situation at the undergrad- 
uate level. According to that survey, two-thirds of the public four-year * 
iriHtitutioni studied and three-fourths of the private four-year institutions 
required either SAT or ACT test scores as part of the credentials package for 
each applicant. Other important parts of the credentials packages were high ^ 
school transcripts, health statements, letters of recommendation and personal 
essays or autobiographical statements (those last required by 40 percent of the 
private four-year institutions). Institutions also prefer a certain number of years 
of high school study in English, mathematics and so on, as part of the s(»lection 
criteria. 

When asked whether ACT or SAT scores were the single most.importanC factor 
in the decision-making process, very few schools replied affirmatively. 
Ninety-nihe percent of the most selective institutions reported that the scores 
were not the single most important factor. However, about 60 percent of the 
public and 54 percent of the private four-year institutions said that imi scores 
are a ''very importan^t factor" in decision making. The percentages are much 
lower fox the "open-door" admissions and two-year institutions, v/\uch the 
majority of Americans students attend. f 

These statistics suggest that, at the undergraduate level, test scores are rarely 
the sole 'criterion for admissions, tilthough they are considew^d very important 
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How Well 
Trained are. 
Admissions 
Officers? 



by a majority -of ^ur-year institutions, Thexbta do not prove that institutions 
which consider test scorfes very important s^e not still overestimating their 
precision or overvaluing them in some way. In order to get at the misuse 
problenvmore directly, we need ev^h more informiation about both undergrad- 
uate and graduate selection processes. Some in-depth studies might be useful, as 
would a survey of admissions officers' knowledge about the characteristics and 
limitations of aptitude tests. If we found that many of them harbored ( 
misconceptions, we would not only have grounds to, support allegations of 
misuse by institutions but we would 'know wl^at kinds of abuses were most 
prevalent and in need of correction, ' - • ' 



How Are 
Cutoff Scores^ 
Used? 



Is Test Information 
Available? 



Is There a 
Culturul, 
Disposrtion to 
Misuse ? 



!h/nad Tests, 
Constitute 
Misuse ? 



OnQ misuse issue that has surfaced often in testimony is, the **cutoff score'' 
controversy. Some proponents of legislation argue that institutions use cutoff 
scores to determine eligibility. This practice would represeht a misuse of the 
tests, most of which are n^fftTrffitjiently accurate t||b.permit sharp distinctions in 
scores. Representatives of the^iimttutions generally deny that cutoff scores 
exist. Obviously, tlie test scores are used for making some discriminations; all. 
other things being equal, an applicant with a higher score is probably going to 
be selected over one with a lower score. Just as obviously, most universities 
can demonstrate that the test scores of their freshman span a considerable 
range of percentiles. ^ 

Another approach to the misuse problem would be to assess the kind and 
aniount of data test^yblishers now make available to test score users. Are their 
haftdbooks and explanatory materials readily understandable? Do they explicit- 
ly emphasize test linVitations or are the limitations only implicit in statistics 
that few readers will attend to or understand? Are the handbooks and materials 
widely available? •.■^they^ updated often? Wh^t do admissions people do with 
the handbooks? . ^ 

A third approach to misuse is to develop deeper understanding of the social 
forces that seem to promote it. Is there a cultural disposition to automatically 
accord things like tests a truth value they do not deserve? What are the root* of 
that disposition? More information about this would ?larify the context in 
which certain misuses take place and perhaps enable us to design corrective 
strategies for all the actors involved, including testing companies. ^ 

Some y^X)ponents of • legislation argue that simply administering a badly 
designed test con^ti^tutes misuse. In other words, the issue of abuse is 
inseparable from' the issue of test quality: a bad test will be misused as soon as 
anyone bases a decision upon it. This point of vieW would distinguish two 
categories of misusja: mi»Use at the hands oi people who use the tests and 
"intrinsic" misuse Chit necessarily follows from a bad test. It is^easier to argue 
that disclosure legislation will not* prevent the forn\er than it is to argue that it 
wiir not affect the latter. The problem of intrinsic misuse relates to all the 
issues raised in Chapter I about -the quality of standardized tests. If full 
disclosure reveals that f)articular tests do not meet reasonable standards of 
quality, it will prove that intrinsic misuse does indeed exist and it will provide 
some pressure to raise standards or decrease dependence U[)on the test scores. 

Pr9po$1tion 3. l4egulatory legislation requiring full disclosure will soften the influence of 
testsjjpon life chances and will help correct problems stemming from misuse. 



Has ''Truth'* 
l^efiisUitiou 
Accomplished 
Reform ? 



One way to tost this prof)()sition is to look at th(^ past. Are there other areas in 
which legislation has accomplished similar goals? What benefits have been 
reaped from various other ''truth" and ''sunshine'' bills? Do the hills and laws 
go to tjhe heart of the problem? 
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One way in which supporters of full disclosure feel that the law can correct 
abuse has already been noted: they feel that it will raise consciousness about 
the limitations of tests and force tesi^evelopers to meet standards of quality 
that are acceptable to. the public as well as to psychometricians. Those test 
developers who have tied test quality to the technical issue of security have 
been unable to agree, of course. To them it is a contradiction in terms to ask 
for a **quality" test that is not secure and^annck be confidentially validated for 
individual institutions. T^iey feel that a paradoxical outcome of the law could 
easily be that in proving that their tests are of high quality in some respects, the 
test companies will lower the quality of" the tests in other respects. In order to 
urtderstand this dispute more clearly, one needs to know what ^*iquality" means 
to %ill act^^rs in this drama and whether there are not some combinations of 
technical and lay definitions that would satisfy most reasonable people. 
Otherwise, the effect of the legislation upon test quality is moot. 
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Will the Paws correct misuse of tests and scores by counselors, personnel 
officers, admissions officers T[nd others (assuming such misuse exists)? The 
effect of the laws upon users is somewhat incjirect, since the laws regulate ohl^ 
the test manufacturers. To the extent that practices change while the Is^ws are 
in effect, someSnight find a causal connection, but it would be difficult to 
prove. 



Will ^ 

Legisfafion 

Raise 

Consciousness? 



mxai Does **Quality'' 
Mean to Both Sides? 



Will La WH 
Affect 
Admissions 
Practices? 



Another way to test this propb^ition is to look toward the future. New York 
and California hav(? enacted theiKlesting laws, and others should be able to 
learn from their experiences. There\[s a great opportunity here to gather some 
prelegislation data bearing on the key issues at stake and initiate some 
continuing efforts to monitor events. 



A ^inal question about this propdjition is' whether* there are other ways of 
c6rrecting the problems short of state or federal legislation. Will test companies 
move to correct the perceived problems on their own, without governmental 
regulatian? How enforceable are the APA standards? Could the ^psychometric 
and admissions communities take a stronger tole in setting and enforcing 
standards? Whether or not the testing companies would have /moved in 
directions their critics have urged without l^islative hearings over the last year, 
one cannot know. But it is clear that they are now moving in those directions, 
'faster than ever. The Public Interest Principles released in January 1980 by the 
Educational Testing Service, the College Board, the Graduate Management 
Admission 't^ounbiJ, the Graduate Record Examinatie'iisSioard and the Law 
School Admission Council, represent an attempt^o be responsive to the issues 
raised by the le|^ation, without endorsing the legislation itself. Clearly, the 
legislation has already had some impact on testing activities. 



Are There 
Nonle^islative 
Remedies? 
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B. Evaluating Arguments From Principle 

Conceivably, sonieone could gather the information required to test the 
foregoing proposition? and ccwiclude that the evidence is not sufficient to make 
the case for legislation. -But Xhis would not tjpKhe end of the matter. There 
remain ''strong arguments from principle to contend with. The most common 
one is expressed in the phrase by which all the legislation has come to he 
known: truth in testing. The argument is that this is a matter of truth, fairness 
and open governance. Against su(*h ideals, technical or financial arguments 
should not prevail. ♦ 

stated so baldly, tho issue looks easy 4o decide. Any red-blooded American will 
jfome down on the side of truth and faHriess. W\deed, for some people, the issue 
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fCvaluatinff 
Opposition to the 
Arfiumcnf From 
Principle 



The Fairness 
Argument at Its 
Strongest 



Will Open 
Testing Lead to" 
Further 
Unfairness? 




fs Security 
Central to 
Validity? 



Will Lower Quality ^ 
Tests Result From 
Disclosure? 



Can Items He 
Reused? 



is just that simple and the decision just that automatic. However, it is 
somewhat more complex. To begin with, the use of the word "truth" begs the 
questioff in this arena just as it does in lending or advertising. It is a political, 
not a descriptive term, more divisive than helpful. The term fairness is more 
comfortable for both sides, Strenio puts the fairness argument in its strongest 
form in The Debate Over Open Versus Secure Testing: A Critical Review, When, 
he points out that open testing might be more fair to individual test takers 
(who have a right to know the basis on which they are judged), more fair to the 
general public (which is seeking account^ltjility) and more fair to<the testing 
companies (who have a right not to be unfairly accused of hiding something). 
In addition, to t^ie extent that acLyissions tests are defayto instruments of 
public policy, opfeil testing is more Wk to our society, which, being democratic, 
should prefer governance in the open. / • 

Opponents of legislation argue that fairness is jilready at the heart of test 
design, development, administration and use. Th^point of having secure, 
standardized tests is to give decision makers informa^iqn about students thatr^ 
does not confer -unfair advantages to some of the*stud«its. From their point ^f .^ 
view, an admission^rocess resting upon political judgments and no standard 
against which to measure academic abilities^ of people from very different 
backgrounds would be grossly unfair. If disclosure legislation were **fair" to the 
students who wanted to see their tests but, at the same time, destroyed 
security, eroded the quality of tests and reduced confidence in them, it would 
end up being "unfair" to a much larger group of students and to the society at 
large." ^ 
% 

The fairness issue, then, boils down to a matter of competing public interests, 
and igresents a final proposition to test. The proposition advanced by 
opponents of the legislatioh is that in being fair to one group we may be 
imposing unfairness upon other groups. To test the proposition, one should 
.know whether, in fact, test security is essential to test validity; whether 
disclosure will erode' te^trquality and confidence in test scores sufficiently to 
destroy the utility of admi^ions tests; and whether, in fact, a decreased 
dependj^fTcTu^K^n standsgrdizechdest scores would take the country back to less 
fair sj^dards for admission to hWher education. 

. • ■» 
Is security so.cOntDal to th?validity/of the tests that to breach it is inevitably to 

lower the quality and utility of the tests? lAs noted in Chapter HI, xthe 

Association of Americun Medical Co41eges argues that it is and^so do a number ' 

of prominent psycho metapwians. But there Ve also psychometricians who otaim 

. ''that security need not be tied to validity and utility and that open testing is 

feasible. Apparently^ the best ^nswer to this question is that it depends upon 

the test, its design^and its use. The debate could profit from a dear explanation 

of this point on a t^^ by test basis. ^ 

: Will the need to"|reate more test questions inevitably reduce their quality? 
Some test eonstru^^s arfjue that in certain subjects, the number of good 

; questions is limillS^arYl disclosure will sponer or later exhaust the supply, 
lowering the qualjty oT the test or ruining its predictive*validity. Some will 
iCounter that wJlys^vOf conceptualizing subject matter areas change over time, so 
th# tests will hav*^lo change along with them. Static subject matter areas that 
are exhaustible do not exist, they argue, for if they (jXf, knowledge would be 
st'^jinding still. 

• Is U necessarily' true that exercises, once released, (*an never be used again? 
Perhiips, after a certain period of time, old exercises can be roused wi|,h little or 
no d\mage to a test's validity. It is a tesUible hypothesis. 
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Will disclosure erode confidence in the tests among users? The answer would 
seem to depend upon the answers to the first twQ questions. If responsible 
persons demonstrate that disclosure will not impair the quality of certain tests 
then there is no reason why users of those tests should lose con^jdence in them. 



Will Confidence 
in Tests Suffer? 



\ 



If test users do lose confidence in the tests, will their decreased dependence 
upon the tests lead to less fairness in their decisions? To the extent that 
admissipRS. people dq not rely heavily upon test scores, there should be little 
change in the fairness of their selection procedures. To the extent that they 
rely heavily upon test scores, the answer depends upon their confidence in 
available alternatives such as grade point average or institutional tests. 
Certainly the total disappearance of ^ standardized measure against wh^rh to 
conipare students from .^iiffering backgrounds would affect the fairness m the 



admissions process. But there is no evidence that testing 
necessarily lead to the disappearance of standardized tests, 
founds appears premature. 



legislation will 
Fear oi^ these 



r 



The proposition that disclosure necessarily leads to lower quality tests and thus 
,to an unfairness worse than the unfairness the legislation seeks to redress, needs 
. more comprehensive testing before it can be said to be proven. 

The preceding discussion suggests that the following are critical questions eachC 
person confronting this issue must answer in order to arrive at a position: 

'l.Is there a ''problem" with testing that requires state or federal 
legislative action? 

2. Is open testing technically feasible? for all tests or only certain 
ones? 

3. What will be the consequences of open- testing for various kinds of 
tests ajid levels of education? ^• 

4. Will .open testing erode or enhance corrfidence in the tests? with 
what result? 

5. Will any personal, social or educational benefits of open testing be 
offset by such problems as decreased validity, increased cost or 
jK^duced use of the tests? 

6. Uo test (Companies already release sufficient information? 

7. Are there partial disclosure plans that would be preferable to full 
disclosure? 

^ 8. What is the magnitude of Standardized test misuse? in admission to 
' postsecondary schools? professional schools? elementary and 
. secondary (education? 
■ 9. Will disclosure ll^gislatjon corret^t misuse? \ , ^ 

10. What legal and ccuistitutional problems are raised by which 
provisions iq. current testing laws? 

Where one stands on this complex issue will depend upon the answers to the 
questions raised by these propositions. People who feel that the burden of 
establishing the need for le^iislatiqn rest^ upon those who are drafting it are 
likely to want to test the first three .propositions. Those who feel that 
opponents of the legislation must prove that the fairness principle does not 
apply are likely to want the last proposition tesU^d. It Should be (^lear that both 
proponents and opponents of legislation have homework t(y do.-If legislative 
debate does nothing else than bring more, information and clarity to this vague 
public policy area, both sides will have been Wi^ll served by it. 
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APPENDIX A 

H. R. 3564 



To require all educational HdmissioiiR t»*sting oondurtnl tlirou^jli iiilrrmftic com- 
merce, and all fKrupRtignal Rdmissionx trstin); (wliidi affrrts rauuiUTCo) to 
bo conducted with sufnc-icnt notice of tosi subject tunttcr and lost roxults, and 
Cor otber purpose*. 



IN THE HOUSE OF RKPUKSKNTATIVK8 

Ai'Rii, 10, 1979 

Mr. QlBBONB introduced tbo following bill; whirb was r('ftirF4»d to ihi* Conitnitteo 
on Kducation and Labor . 



^ A BILi: 

To require all educational a(lini.s«ion« toBlitig rouductc^d Ufrough 
intftratate eonmiorce, and alj occupational adini.ssionJi testing 
(which affects commerce) to be conducted witlf sufficient 
notice^f to8t Rubjecynutter nnd test Tcsults, and for other 
purpoR(^fl. ^ \ 

\ 

1 fie it enacted hy (he Senate ami House of Uepresenta- 

2 (wen of the United States of A meriea in (Umjirns assemhled, 
' 8 That this A(»t may be (Mted as the '"l^||p|i in Telling Act of 

4 umy\ 

5 * Src. 2. Ah used in this Act— ^ 
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(1) the t(Min "oducjitional lulMiissions trs(" inonns 
any U'8t of npiitudc or kiiowlcdjjc wlm h— 

(A) is adiulnistcnMl to individuals in two or 
more Stntrs, ^ 

(B) afforts or w rondiirtcd or distributed . 
through unv iiKMliuni of iiitcrKtato coiiiiiu'rrr, mid 

(V) is usod as part or all of the basis for ad- 

niittiiig or denying admission to uii individual to 

any institution of higher education; 

(2) the term ''oecupational adniissimis test" inejuis 
any test whieh'is used as part ^)r all of the basis for 
admitting or denyii^ admission to an individual to any 
o<'eupation iAor affeeting interstate eommeree; 

(II) the jterm ''test" includes any aptitude or 
aehieve;nent^examinati(m, whether written or oral, and 
includes any obj<M*tive iiudtij)l(^ elioice, nu»ehin(^ scored, 
essay, pnu*ticnl, jierforni^ince, or demonstration exjiini- 
nation; 

(4) the term latest scok?" means tlui mnnericnl 
v^lue given to the test y^ubjeeVs perfornuince on any 
test; 

(5) the term "person" includes iiidividuuls, corpo- 
raluuiH. ccMupanies, associations, firms, partn(*rships, 
KocietTes, joint stock co!n[iani^H, and Ji^^eucies and in^ - 
stninientaiilies of Slates and local governments; and 
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({)) the term ''institution of higher education'* has 
/the meaning set forth in aeetjon 1201^0 of the Higher ; 
' tcJi^'ation Act of*19G5 (20 U.S.C. 1141(a)), 
Skc. 3. The (Congress hereb^indfl['and declares that- 

(1) testing of Rcholas/c aptitudes and achieve- 
ments has b(?coine a principal factor in the admission of 
individuals to public, as well as to private, institutions 
of higher education and that thcreforu equal opportuni- 
/fA* under the law requires that that testillg be conduct- 
ed in a manner which will (insure the equal rights and 
fair treatment of such individuals; 

(2ytestiug of skills for entry into an occupation, 
wli^l^cr ()f If professional, craft, or trade nature, is a 
critical factor ^vernilig the free' flow of individual 
skills in interstate connnerce *nnd seriously affects the 
Nation's capability for economic growth; and 

(3) the rights of imiividuals and the national inter- 
cj?ls can be protwicd without advers^dy affecting the 
proprietary interest of any entity admniistering tests by 
simple* re(|uirenients governing proper pri6r notice to. 
individuals of the sulijcct matter to be tested and 
proper snhsecpuMit notice of tj'st n'sults aiuNh^'ir uses. 
Skc. 4. It ij? the purpose of this Act to prohibit the 



24 conducling of ednchtioiuil and oc<'Upa(io!Uil admissions tests 

25 unh*ss ^uch tests au* administered in a manner to protect the 
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rights of the Individuals tested and to grant a Ft;dcral cause 
of artion to any individual adversely affeeted hy ttu' adininis- 
tration of any sueh test in vjolatlon of this Act. 

Sk(*. T). It is unlawful fdr any person to administer any 
educational or oceupationahadniissions test to any individual 
unless sueh test is administered in accordanee with the re- 
quirements of section 0 of this Act. 

Skc ii. (a) Kneh applicant to take aliy edu**nti(nial or 
o(*eupati(mal admissions test shall he provided with a written 
notice which shall contain 

(1) a detailed description of tiie nren of knowlcd^r^ 
or the type of aptitude thai the test nitempts to nni^ 
lyzc; 

(2) in the ease of a test of knowledge, ii dctaij(*(l 
description ol the snhjecls to he tested; 

f'i) ti^ margin of error or the extent of rcliiihility 
of the teKt» determined on the hasis of rxperiincnln! 
uses of the lest and, where nvaihilrtt\ Jtctnai usage; 

(1) the nu^er in w^ich the test resnlls will he 
distrihntcjl hy the telling eltily to the applicant and to 
other persons; and 

(.">) a ^Inlemenl of the iJpplioinrs rigiits under 
snhsectio!! (h) of this section to ohtain test results and 
related facts. 
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(h) Ka<di ii\dividual who takes any educational or occu- 
pational admissions t<>st shall, at the request of the test 8ub> 
j(M>t, promptly upon completion ^f s<*oring of such test, be 
notified of — I 

(1) tla* in<livi<luarH sp<MMfie performance in each t)f 
tin* suhjiM't or aptitu<h» areas test<'d; 

(2) how that sp<MMfic j)erformance ranked In rela- 
tion to t!n» oth<T iudivi<luals and .how the individual 
ranked on totiii test p<'rformaiic<*; 

(*0 (lie score r<Mpiir<Ml to pass the test for admis- 
sion to such (-ceupation or tin' score which is generally 
re(|uirt d lor ndi!ii>'^i(ni to institutions of higher educa- 
tinu; 

(1) liny Inrther infoi iunfion which may he obtained 
h\ ihe iMdivi(hi.d on r(*(piest. ^ 
(c) No edufalional or occup<ilional admissions test which 
tcsN knowledge or achievement (rather than aptitude) shall 
he ^(r;)<j'd (for j)urposes of <h't<Tmining the score required to 
pjiv^ :lie Ir 1 |mi rulrnission) on the hasis of th(^ relative distri- 
hution of scores of oilier tt'st snhjeets. 

Si;r. 7. ( j) \Vlicne\'J^' any p<'rson has admiiustered or 
there are reasoiiahle grounds to Ixdieve that any person is 
nlumt lo .'idmini-^ler iiny edueati(nuil or occupational admis- 
sions tesi in vi(dali(»ii of this A(*t, a <Mvil iicti<m for preventive 
reli(»f, iiK hiding an applieulion for a pernuuient or temporary. 
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1 injunction, restraining oriler, or other order, nipy be institut- 

ft 

2 ed by the incfividunl or individuals uggrieved. Upon applica< 

3 tion by the coinplainnnt and in .Muh circumstances as the 

4 court nmy ih»eni just, the court may. appoint an attoriicy for 

5 such complainant and may authori/.o [Upt comincnrcncnt of 
(5 civil anion \vith«nit payment o! !ei's<-eosts, oi si'curity. 

7 (b) In any action coiniiieiiccd pursiiuni to tbi.^ section. 

8 the court, in its discretion, may allow the prevailing party, 

9 other than the Ignited States, a reasonable attorney's fee is 

s 

10 part of the costs. \ 

11 (c) The district courts of the United Stjites shall ha^e 
V2 jurisdiction of proceedings in.^titulrd pursu.mt to this Act v.^nl 

13 shiill excrci«^e tlie same \vjtbr)ut rcj-rnrd \n ^^lu'tber \ht\ 

14 grieved party shall have ohnu^lcd ;niv* ;i(lnnn'strat;\e or 
If) other remedies tlyit may be j)rovidcd by lAw. 

10 iSkc. H. This Act shall be effective \itli respect to any 
17 test administered on or after .lanuaiy I, UiTO. 

O 
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APPENDIX B 



H. R. 4949 



To rr(| iii<' ciTinin iiiforniutlon bo provided to individuala who take utandardizcd 
cdiuntioiial ndinissions tosis, and for other purposes. 



IN TUB HOUSE OF REPRESENT ATIVES 

July 24. 1079 

Mr. \Vi:iH8 (for himself, Mr». C'niHnoi.M. and Mr. Mn.l.BK of CtlifomU) intro- 
(hu rd the foMowin^ bill; which was rofoirod to tho Committee on Educttion 

and Luhor 



A BULL 

To require certain information be provided* to individualt who 
If take standardized educational admissions tests, and for other 
purj)oses. 



\ 
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Be it enacted by the Senate and House of Represenia- 



2 tiirs of thv United Stjites of Amcnva in Conyrenn (issemhledt 
W j HHORT TITI.K 

'1 iSkction 1. This Act may bo cited as tho ''Edueational 

5 Testing Act of 1979*'. 

/ 0 FINDINOH AND PURPOSE 

7 Skc. 2. (a) The Congress of the United Sutei finds 

8 that— 
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(1) rducntion is fundnmental to the development 
• of iiulividunl citizens and the progress of the Nation ns 

u whole; 

(2) there J^a continuous need to ensure equal 
access for ty)f Americans to educational opportunities of 
a high qua 

(3) standardized tests afe a major factor in the ad- 
mission aiid placement of students in postsecondary 
eiliicntion an^^ilso play an important role in individ- 

, uals* professional lives; 

(1) there is increasing concern among citiz(*ns, 
educators, and public officials regarding the appropriate 
uses of standardized tests* in the adniis^jionj; (l(*(i^;l()n of 
postsecondarv education institutions; 

(5) the rights of individuals and the puMic iiitt rrsi 
nm be assured without cndangeriiig th« j)roj)rit I iry 
^righls of the testing agenrieK; and 

(0) slaiidnrdixed tests nre (levJo; ' -I 'I.m; l.-- 

Irred without regard l() Si ite boii'idm i'*s-: A ir • ■ 

ii/rd on u nnliouni biisls. 
t 

(b) lt*is the purpose of this Act — 

It 

(1) to ensure that test snbjeels' and pcr' -^is who 
use test results are fully aware of the rbjinirfnfisfic^-. 
uses, and liinitatitms of slaiulardi/ed tc.ls in po^I- 
seroiidnrv education adniissioiis; 
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(2) to make available to the public appropriate in- 
formation regarding the procedures, development, and 

r 

administration of standardized tests; 

(3) to protect the public interest by promoting 
more knowledge about apprppriate use of standardized 
test results and by promoting greater accuracy, valid- 
ity, and 'reliability in the development, administration, 
and interpretation of standacdized tests; and 

(4) to encourage use of multiple criteria in the 
grnnt or denial of nny significant educational benefit. 

INFORMATION TO TKHT SUJUKCTS AND P08T8BCONDABV 
KnrCATIONAL INSTITUTIONS 

Skc. 3. (n) Knrh test agency shall provide to any test 
s'ubjeet in (»lear and easily under^ndahle language, abng 
with the registraliou form for a test, the following informa- 
tion; 

(1) The purposes for which the test is constructed 
Hiul is interuled lo he used, 

(2) The subject matters included on such test and 
the knowledge aiul skills which the test purports to 
measure. 

(3) Sinteineiils de^i^^ned to provide infornuition for 
ijilcrpreliug the te^t it-^dls, including e\planations of 
the %'st. and the correlation between test scores and 
future success in schools and. in the case of tests used 
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1 for JH)^^l»Jllt•al:ull^ut^ mlini-^iniis, lltr'slsuularil rnor of* 

2 iiiral^MU-mciit nml tlic ( (in rlallon hn\v(M'n test scores 

3 nnd surcrss in \\\v cnnu r l(;r \\\\\v\\ luluiissioii Is 

r, (.J) Statnnriils coium iu'im^ llir cUn t^! oltsmul uses 

0^ of tost scorrs. - ] 

7 (A) if tlir test score is ii>c(l hy itself or with 

8 other infornuitioii to predict futiire ^nn\v point 
5) nverage, the extent, cxpres^^cd as a percentage, to 

10 uliirh tlie nav of tins test score improves the ac- 

11 curacy of predicting fjiture grade point avt^rage, 
1^) over and ahovc all other information used; and 
13*'*'^'^ (II) a ccnnparison of the ^\erngc sco^c 'and 

14 percentiles of test snhjects hy major income 

15 ' gnmps; and 

10 / ((') the extent to which test preparation 

17 eotirscs improve test suhjects' scores on average, 

18 expressed as a j)ercentage. 

19 (5) A descrij)ti()n of the form in which test scores 

20 will reported, whether the raw test scores will he 

21 altered in any way hcfcire heiiig reporl^Mi to the test 

22 snhject, 1|id the maimer, if any, tlie test agency will 
2;j ii^e the test score (in raw or transfornuMl form) hy itself 

24 or together with any other information nhont the test 

25 • sithject to predict in arty way tlie snhject's fntiire aea- 



1 d(Mnie performanee for any post secondary education! 

2 institution. . « 

:J ((5) A complete description of any promises or 

4 covenants that tlu^ test agency makes to the teat sub- 

5 jeet witli regard to aceurney of scoring, timely forward- 
(I ing or score reporting, and privacy of information (in- 

' 7 chiding test scores and otlicr information), relating to 

8 tlu' test sul)jects. 

\) (7) The property interests of the test subject in 

10 the test results, if any, the duration for which such re- 

I.l* suits will he retjTined hy the test agency, and policies 

12 regarding storage, disposal, and future use of test 

IIJ scores. 

I j (H) Tlie time period within which tlio test sub- 

If) ject s tc^t score will he C(mi|)h'tc(l and mailed to tlio 

Hi tr<t subject and tin* time period within which such 

17 * scores will hcjmailed to lest score recipients designated 

18 hy tlie test suhjccl. 

19 (!)) A description of special services to accommo- 

20 date hnndieappcd test sidijects. 

21 (10) Notice of (A) the inhirmiition which i.s'availa- 

22 to tlie tc-<t snhject under sedinn ri(a)(2), (B) the 
2IJ rights of the test siihjcci umh'r seeti(m 0, and (C) the 

24 procedure for appeal or review of a test score by the 

25 fest agenev. 
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I ill^^i^u^.oJl whli h i*^ i\ tcsl svurv rccijilcni * 

*J hv I'lDvidctl with \\\v xuUnw.iUuw rc(|imc(l l)y snh^cclioil (a). 
l\ TUv hsi a^fiH y <\u\\\ |)ii.vi(l(» siuli inloninUion wilh nspect 

^ , .,/...■ 

ii ((•) Tin' li st ii|;rii( V -Ii ill Miiim ili:i:i'!\ iidtiU lln- h i 

7 sul)j<*(t and (lie in<(it;ilin^N (Ic-it^nnd d ;is tc^i sc()r(» rccipicnis 

8 by th(» tcsl subject if I'lc lest sid)j(M ('s ^ntvr is (l(day(»(l Icii 

\) CHlrndar dnys beyond ibo time period sinted tinder snbsretion 

10 (jiMH) of tbls sedion. 

i 

11. KKI'OIITK ANI> KTATIKTK'AI, DATA AND OTHKH 

IL' [Nl OKMA'i'lON 

l.'J Skc. \. (a)(1) In ()rd/'r to further liu' purpose*^ of this 

14 Act, the f(dlo\vinp[ information "^haii hv provided to th(* Com- 

IT) nnssioncr hy tbc test agency: 

10 (A) Any study, c\1rtTh^)n, or statistical rcp(>rt 

17 pertaining to a tcsl, which a test nf^eney prepares or 

18 causes to be prepared, or for which it pi o\ ides data. 
Nothinf( in this paragraph shall re({uirc sul)mission of 

20 any reports or docunuMits eontaining irdornnition idcnti- 

21 finbic with any individual test s!d>ject. Such inforina 

22 lion aball \U' deleted or obliterated prior to .Submission 

23 to the ( 'onnnission(»r. / 

24 (ii) If one test agency develops or produces a test 

25 and another test agency sponsors or adniinistcrH the 
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1 sanu^ test, a co|)y of their contract for Bcrviccs shnl! be 

2 submitted to the (^ommissionor. * 

M (2) Ail daia, reports, or oth<?r documents .snbmittrd piir- 

4 suai.l to this section will be oonsidcrcd toj)0 records for pur- 

f) pn ,v> <d secti(m r)r)ti(a)(.'0 of title T), United States Oodc. ^ 

(I (b) Within one year of tin; effective date of lliis Act, the 

7 ( 'ouunissioncrs sl^tii report to Congress concerning the reln- 

H ti(mshi|) between the test scores of test subjects and income, 

\) race, sex, ethnic, and handicapped statuB. Such report shall 

10 include an evaluation of available data concerning the rela- 

» 

1 1 tionship between t<»st ^vorvn and the completion of test prepa-* 

12 ration courses. 

VI 

I'U()M()TIN(J A nKTTPWt I^NDKHSTANDINCJ OF TKKTH 

I I Si:c. f). (a) in order to pronuHe a better understanding 

If) (jl stinuinrdized tests and stiundate iruiependent research on 

H) such t(»sts, each test agency — 

17 (I) sbnll. within lliirty days aflijr the results of - 

^^ any staudaidlz(»d test are relcase<i, file or cau'c to ^■ 

l!^ fi'( ,l in |lie office of the ( 'ommisitoner — >^ 

l:l>» (A) a copy of all test questions tmitxn calcu-^ 

, 1.1 

21 biting the test subject's raw score; 

•J*J (11) the corresponding acceptable answers lo 

'2IJ those (juestions; and 

24 \ (0) ail rules for transferring raw scores into ^ 

25 those scores reported to the tost subject and poBt- 
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8^ A \ 
secondary educationai institutioiif/ togcUhrr with 

an explanation of such nUes; and 
(2) shall, after the test has been filed with the 
Commissioner and upon request of the test subject, 
sJhvT the test subject— 

\ (A) a copy of the te^t questions used in de- 
ternnning the subject's raw scor.e; 

(B) the test subject's individual answer sheet 
together with a copy of the correct answer sheet 
to the same test with questions counting to^vard 
the test subject's raw scofe^o marked; and 

(0) a statement of jht^^v score used to cal- 
culate the scores already sent to the test subject if 
such request has been made within ninety days of 
the release of the test score to the test 8ul)j(*ct. 
The lest agen(7 inuy charge* a nominal fee for sending out 
such information requested under paragraph (2) not to exceed 
the marginal cost of providing the informHti(m. 

(b) This section shall not apply to any stnndardi/ed t^st 
for which it can be anticipated, on the basis of past experi- 
ence (as reported under section 7(2) of this Act), will hv ad- 
ministered to fewer than five thousand test subjects national- 
ly over a testing year. 
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1. (c) Documents submitted to the (Commissioner pursuant 
2 lo this section shall be consid(Tcd to be records for purposes 
\] of section r)r)2(a)(3) of title 5, United St^^te^-Code. 

4 PKI^CY OF TEST HCORKS 

5 Skc. G. The score of any test subject, or any altered or 

6 transferred version of the score identifiable with any test sub- 

7 ject, shall not be released or disclosed by the test agency to 

8 any person, organiajUion, association, corporation, post- 

9 secondary educatiohal institution, or goi-ernnuMital agency or 

10 subdiv^sio)i unless specifically authorized by the test subject 

1 1 as a score recipient. A lest agency may, however, release^ 

12 previous scores receiv(»d by ft- test subj(»ct to any currently 

13 designated t^st score recipicrUyt'his section shall not be con- 

14 strued to prohibit release ((fHvb\vfi and other infonnaticm in a 

15 form which does not identify the test subject for purpo.ses of 
in rcseiiroh leading to studies and reports primarily concerning 
17 the t(;sts themselves. 

IH TKSTINCJ COSTK AND FKKS TO «TlH)Eft^T8 

19 Skc. 7. In order to ensure that tests are bemg offered at 

20 a n-nsonal)le cost to test subjects, each tost agency* shall 

21 report the following information to the Commissioner: 

22 (I) Before March HI, 1981, or >yilhin ninety days 

23 aftcT it first becomes a test agency, whichever is later» 

24 the teat agency shall report the closing date of its test- 

25 ing year. P'ach test agency shall report any change in 



04 



r 



10 



1 the closing date of its testing yonr within ninety days 

2 after the change is ^nnde. 

:\ * (2) For each test program, withih or.e hundred 

4 nnd twenty days after the close oftht^ testing: year tlie 

f) test agency shall report — • 

0 (A) the total nuniher of times the test was 

7 ^ taken during the testing year; I \ 

8 (B) the numher ^f test suhjeets wh()\hav(' 

9 taken the test cnice, who hav(? taken' it twice? and 

10 v.l)o have taken it more than twice during the 

11 testing year; 

Ig (C) the ^numher of refunds given to inc^vid- 

13 nals wlu) have registered for. hu» did not take, the 

14 ^ test; 

If) (D) the numher of test suhjeets for,whom the 

1(J test fee was waived or reduced; 

17 (E) the total anu^mt of fees received from 

l^ the tc^t Buhircm hv test ngenev for each test 

f 

19 program for thnt test yi fir; 

20 (F) the total amoiml of revenue received 

21 from each test program; and 

((i) the expenses to the test agency l^the 

2!J tests, inchiding — " ^ 

24 (i) expenses incurred by the test agency 

25 for each test program; ^ . 
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(ii) expenses incurred for test develop- 
nieiU by the test agency for each test pro- 
grain; and 

^(iii) all expenses which are fixed or can 
he regarded as overhead expenses and not 
;i >(/U'U((l with any test program or with 
test deveiopuient; 
(W) if a separate fee is charged lest subjects for 
admissioiis data assembly services or score reporting 
services, within one hundred and twenty days after the 
dose of the testing year, the test agency shall report — 
(A) the utnnber of individuals registering for 
each ndmissions data assembly service during the 
testing year; 

(H) the number of ifitiividuals registering for 
each score r^orting service dtiring the testmg 
year; 

((*) the total amount S)f revenTie received 
from the individuals, by the test agency for each 
admissions data assembly service or score report- 
ing service during the testing year; and ^ 

(D) the expenses to the test agerjcy for each 
admi'-sions data assembly ae]^ico or score report- 
ing service during the testing year. 
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.1- ' ♦ KKCJl'LATIONS AN,^I>^I'()K('KMi: 

2 Skc. M. {\h The Coin^JjssioMcr shall [)n)iiiu!^j{<K^ rr«,'nln- 
tiiHis to impl/iUMit lliP provisions of llii^ Act wilhiV one liun- 

\ (Irod iind twenty days nftcr tlir rffrrlivr datr of this Act. The 

i) faihirc of the Commissionrr to proimil/^ntr n'^idati(Mis slijill 

• i) not pn'\>Mit tl^^ovisionK of this Act from taking, effect. 

7 ^ (I)) Any test ageiiey that viohites*any ('lanse cif any pro- 

8 vision of thr>i Art shall he llahle for a ei\il penahy Uf)t to 
S) e\( ee(i.$'J,(M)() for eac h \if)latio'n. 

10 (e) if anv provi^-i'Hi of ihi^ Ail shall he ({((hired nn( (ni- 

1 I stitntiornil, invalid, or inappiiealjh', the other provisions shall 

\\1 r( main ih effect. 

Skc. !l. Kbr j)nrpo of llii^ Af t ^ 

(1) the term "admissions data !\*i(Mnhly service" 

ri/eans anv ^nnirnarv or rc port of ^nath ^. ^^rade point 

aver«>>es, slandnrdi/.ed test scores, or any condTination 

»jf j(railes nnd test scores, of an n|>plicant nsed hy any 
• «■ 

-> ■ 

postsecondary (Mlncationai instiintinii in its admissions 
process; 

CJ) the term. "( 'onnin'^^^ifnier** means the Conmiis- 
sioner of lldncation, 

the term "p()s^seeon(buy educational institn- 
ti(^r* nieatis any institution providing a course of study 
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hcvon(i the^ secornlary school level and which uses 
standardized tests as a factor in its admissions process; 

(I) the term "score reporting service" incuns the 
" reporting of a test suhjeet's standardized test score^to a 
te^t ^((.re recipient hy a testing agency; 

(.')) the I(nn "standardized test" ifc "test" 



(A) any test that is use4, •or is recjuirod, for 
I. the pmeess. of selection for adniission to postsec- 
ondary educational institutions or tlieir programs, 
or 

iW) any test nsed for prelimiiu\ry preparation 
f(»r any test that is used, or is required, for the 
jirocess of select^Un-Wm" adnfiission to post- 
secondary cdncatiomU institutions or tlieir pro- 
grams, 

which affects or is coiulucted or distrihuted through 
any nu'd^uNgf interstate eoinmerce, hut such term 
doe.s not inelndf any test designed .solely^)r ncmadmyP" 
sion placement »or eredit-by-examiilatiqn or any test de- 
vch)pe(l nnd administered hy an individual sehodhior in- 
stitnlion for its own purposes only; 

(()> the term "tesf ageiu-y" means any person, or- 
ganization, asso(*iati(ni. (y)rporatioM, partnership, or in- 
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APKNDIX C y 

. V CALIFORNIA ' 

AMENDED IN ASSEMBLY ^UGUST 14, 19^8 
^ " AMENDED IN SENATE JUNE 14, 1978 / j 

AMENDED IN SENATE MAY 31, 1978 
^ AMENDED IN SENATE MAY 9, 1976 

AMENDED IN SENATE "mAY 1,* 1978 / 

•SENATE BILL./' ^ - ^ } NO. 2005 



Introdoced by Senator Dunlap 



00 



* ^ March 29, 1978 

" ' . -tr ■ * 

■ V ' 

I 

An act to add Chapter 3 (coimnencing with Section. 99150) 
to Vpx%. 65 of the^ducation Code, and to amend Section 6254 

of the Government Code, relating to>;po»t»econda|:y education. 

» .. 
LEGISLATIVE COUNSEL DIGEST ^ , 

7* 

SB 2005, ae amended, Ounlap. P^^tsecondary education: 
a1:andar<^ixedf teste* 

ipxieting law ''doee not regulate the act>vifkee of test- 
se/vices which prepare amd ^administer ^standardized tests 
for various purposes related to e^Jucation^ 

^ Ihis bill would require such testing services, defined 
generally As tist *spons^s^ to make various reports to the 



/Callfothia Postsetcond^Kry Education Ccmnission regarding tixB 

administration andXuse of standardised fnf to California 

\ , • ■ ♦ • 

inhabitants* Such reports would relate to both the operation 

and charges for the s)^rvices. Such material would be subject C . 

• ' * * • ■ 

to disclosure, under ;bh4 California Public Records Act^, Test 

\ * ■ I 

sponsors would also be requif^d to file copies of specified 

test questions and answers with the commission* ^ 

This bill would requir^tes^ sponsors to file O^ftiaiin 

informati9n* sufficient to Mescribe the psychometric quality 

of the test • . ^ 

This bill, would requite test^ sponsors to notify 

California test subject;s regarding the purposes of the test, 

the subject matter <^t^ the test, the manner in which the 'test 

is scored, the mannifvin* which the test scores' will be 

■ • • • r * ■ ■ ■ ' . 

recorded, 'the basis upon whioh kcores will be made available, 
and a sample of test items* 

This bill would^ make any test sponsor who intentionally 
violates the bill liable for a civil penalty of not to exceied 
$750 Yor each violation. ' , * 

Vote.x Majority* 'Appropriation: no. Fiscal 

•committees yes. 8tate«-man^ate4 ^^oal programs no. 

. * • 

♦ 

The people of the State of California ^ enact as follows: 
SECTION 1. The Legislature finds i^d declares thats 

(a) Because Btandardlzad tests. 6f tan play a major 

1 ' , i ■ ' ^' » ■ 

./ ' . ' 
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r61« in the adalssloiif plabcMnt, ii|m1 t^valiMition of studmts. 
at all l^viala of out o4uoational myMtmn, 0tudmta/*parants# 
and tha ganaral' public haya tha right tp know an<i to undafr 
ataiid tha nati^a, ^urpoiaa# limitationa, uaaa and potantlais 
of all kindii. and "typaa of atandatdisM taa^a and taat ^ 

tprc^adarfa* / * ♦ 

# • • • * . ' 

\ ' ;\ (b% Standarditad taata cannot aaaauia with abaoluta 
praaiaipn avary attributa'partinant to auccaaa in poat- 
aacondary aduoation. Aa, auoh# thay hava tha 'potantial of 
narroir' intarpratatioh and niaua#« " * c . 

(c) Sinca varipua a^hniCfo ragional, racial, and aoono- 

^»ic groups »ay jiot taat aqually wall on^ atandardisad ^tastp, 
and ainca thaaa taata play, an important rola in datarmini^g 
^atudanta' paraOnal .and profasaional 'livaa# caraful conaidar- 

"^at^on ahoulid ba givan to tha af facts which stkn^^disad , ^ 
taata hava upon tha acb^a^ibility of aqual aducationalK 
opportunitiaa to' all aagmants , oil tha population . ^ 

, (d) It is ia tha public intarast to insura tha .main-" 

tananca of high standarda of qaaUty in tha davalopmant, 

• / ^ 
adml^niatratipfif and . Intarpratation of standardisad tasts*. 

It ip^^tharafora, tha intant of tha liagislatura iii 

anaqting this ohaptar to maka tast sUbjacts and parsons 

Who' usa^suoh tast rasults mora tully .awara of tha 

'^phai^aotarittios, usas, Unitatiohs, and potahtia^ nisusas 

of taata in aduoation, to naka availabla to tha public . 



appropriata infon^ation ragardin^ tha polioi<[8# operation^, 

and faa ati^tura of tha llnitad numbar of organizatlonas^that 
. . ' ' < ■ ■ ' ' ■ .• ■ * •• • 

Hlfvalop .and. adminiatar ' standardisad taata, and to.^llow 

itudanta, ^aducatprS and piiblic offipiala trp kcrutiniza tha 

production and adainistration o^ standardizW taata* 

SBC. 2. Chaptar 3 (comnanoing with Saction 99150) 

is. addad to i;art,65 ofvth^ Education Coda, to raad: ^ 

' CHkPrB^.3/sTAI!inAiqiI2ED TBISTO 

;. . <•.' , ... * - ^ ^ ■ • . • 

99150. Aa uaad in thia chaptar: 

^ V ^ ■ * 

(a) **AdBiaaiona data aaaanbly aarvica** naarta any . 

%♦ •. • 

aunnary or xraport of gradaa, grada point avaragaa; oir - 

■ ! • ► . ^ * . . 

atandardisad taat aooraa of an applicant upad by 'any 
poatsiloondary adubationAl inatitution in ita adstiaaiona ^ 
■^procaaa. » ■ ^ ' * ' . « 

(b) **Co0niaaion' maana tha California Pbataaoondary 
Education Coan^aa ion. 

(c) ***Sacura taat** naana aity taat which contains^ itana' 

* ■ • ■ • * ■ . 

not availabla to tha public and which, to allow (ha fiurthar 

juaa of taat i£aaia and to protact tha, Validity and ralia^ility 

of tha taat, ia aub:)fct to apacial aacurity pi^d0duraa in 

ita publication, diatribution,* and adniiiiatration. ^ 

(d) "Sti^ndardlaad taat" or **taat**, for purpoaaa of^ \ 
this ohaptar, MPna any taat adniniatarad in Cjilifomia'to 
at laaat 3,000 individuala during a taating yaar and which 
if forpally* raquirad by inatitutiona of poataacondaty 
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.•dttoiition for thm purposM of a<£|Bdss lofts to thosji /intrtltutions 
f ''St:andard^«d test** or ''test*' does hot inel,ud« a t^mt, 
./ .or. part of^a taat#Sfhich im admiid.a tared to a , selected group 
. of individuals sqWly for ra^earch, pre-^te9tr* guidance 
counaalingr or placeiMfiit purjposes,, for credit-l>y-examination 
purposes # or for purposc^s ^f meetihg graduation fecjuirements 
of secondary schooxa* Teats which a^e administered as 
^ , supplements or auxiliaries to ahoth^MT'^rtestf or which form | a 
specialized componH^of a test/ may combined for the, 
purpose^a|of thif chapter » ^ ^ * 

(a) **Test subject** meiths. individual to whom a 

. .•■ - -'. - ; V - . 

' standardised test' is administered and who takea' ihe'test 

^t a location in the State of California* ^ « 

■ ■ ■ . ■ . ■> 
\ . (f) "Test' sponsor" means an Individual, partnership; 

corporation^ associationr corfpany, firm^ institutionr * 4 

society r trust/ or^jpint stock company which sponsors X 

Standardised test* ^ ' %- x 

» * ■ • ■ ■ 

* (g) . **Tes ting* year** meanif the 12 calendar months which 

. the test sponsor considers either, its operatipnal^cycle 

4, " " . ■ • ■ ■ ■ *. 

or its y^ri r 

99151. Each test. sponsor shall report* the' closings date 
of its testing year to the commission by March 31, 1979 ^ 
^ ^r within 90* da^s after it first t^comes a test sponsor^ ^ 
whichever Is later. • .1 * 

Bach test sponsor^ shall report any change in the closing 



' date/of its testinf year within 90 days after the change is 

made.* ' v 

> 

99152. ' Within 90 days of tbt:, close of «each testing 

• ■ . ■ * \ ■ 

year, the test sponsor shall .file in the office of the 

commission five copies of the test which is equivalent to 

that in use in any of the prior three testing years, but 

that is no lohger in use as a seclire test, along with the 

corrBsponding acceptable answers. ^ ^ * 

■ \ . » * 

If such a test is no^t available, then the test .sponsor ^ 
shall file instead a set of test questions which are not 
derived from a secure tfest andi^hich ate equivalent in 
content and .of sufficient number to represent the ' secure v 

test fairly, along with corresponding* acceptable answers. 

■ ■ . • ■ ■ . . •■ . 

99153. (a) W|»thin 90 days of the close of each tasting 

• ■ . \ ' 

year^-^^the test sponsor stfall file in the office qf the 

■ * ^ ' ' - .- . ' . ■ ^ • ■' . . 
coemiiasiqii standard technical data sufficient to describe 

■ » ' " ■ ■ • ' ' . ' ' ' - • ^■' 

the psychometrid quality of the test.. 

■ ^ ^* >^ 

For purpeses of dompliance with thip section, it is^ -' 

su^ficien^to deposit with the commisliion information \ « 
conforming to the guidelines sp«|cified in the Stan<|ards for 
Educational and Psychological Tests of 'tha Amer;^an Psycho- 
logical Association, Vhich were in effect 180 days prior 
tenths testing year, > and whidli are appropriytte to the 
pajfticular test and its usei. • | 

(b) Data, reports or other* doctnnents su|6mitted pursuant 



^to this section shall bm aocompanlisd by a. description of 



tha ts^t; ii^clddingt but not limited to the title, purpose 
or purposes of the test andl^ whtn M4ji#h the test was ^ 
Administered In thk state. 

(c) No data # reports or other documents submitted 
pursuant to this ^hapter shall contain Information In a 
^-forrn identifiable with Individuals , or particular post*- 
secondary educational Institutions. 

99^154. « (a) Klthln 135 days after the close of the 
testing year, each test sponsor shall report the following 
data on t^sl; takings, wherever they may occ\u:, to the 

cfosttilsslont ^ 

• , • ^ . . • 

(ij The total nlpber of times tl>e test was taken during 

the testing year* . , 

(2) The number (df individuals who have ^aiken the test 
♦ • . .■ « * 

onCe, who have taken it twice, and who have taken it more 

than twice dur^g the testing year, 

(3) The number of Individuals who registered for, but 
did n6t tkke, .the test, 

(4) Tlie total amount of fees received from t6st**takers 
by the test sponsor for the test for. that testing year, 

fs) The expenses to the test sponsor of the test, as.-* 
follows: 

' ^ (A) Thoge expetyies which are directly attributable to 
the test, 4 . 



104 



(9) TApse expenses whiohNsre indirectly attributable 
to the tett. However # if the test sp^sor a Iso^ sponsors 
another test or related, activities, it shall be sufficient ' 
for compliance .jrlth prcjvislons of this segtloh for the tjwt 
sponsor to 4ist*4ndlr%ctly attributable expense^ tp the \ ' 
extent that they are identifiable, as they are proportionate-* 
ly relifcti^d Nto the test. The. test' sponsor sh/ill also list 
expenses lndlr(B(stly attributable to all activities of the 
testes sponsor, including expenses not identifiable as « 

attributable to a tfst;. 

* ■ . I ■ ■ ■ . 
(b) The financial dlsclbsure required by this section 

Shall be submitted in sufficient detail to indicate the 

major categories or~revenues and expenses asloclated wiTth > 

the test. Except as provided in this section ,-^lhe inferrm- ^ 

ation for different tests administered by\the sam^ test ' S 

^sponsor shall be reported separately and tf^ Iridlvldual tes4:•^ 

99155. If a separate fee is charged telt subjects fpr 4 
admissions datf assembly services, then the test spohsor^^^ 
shall report informatioi> concerning the data assembly services 

in substantially the^ same form as would be repulsed for^ a 

* ■ ■ *■ 
test UQdef Section 99154, ^ 

99156, Any InfcrjiatlOn or report required to be mader ^ 
or «f lied with the commission undsr this chapter is a public 
record subject to disclosure under the Callf6rnlA* Public 
Records Act, Chapter 3,5 (commencing with Section 6250) - 

' V ■ ■ ^- ■ . - - ' . 
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•£ Division 7 9f "Titl^ 1 the;(56vernit«nt Code. 

nothing In this section shall be construed to diminish 
br authorise the infrin^enent *of ,any rights protected by 



lows relating to copyright/ to the protection of trade • ; ^ 
ssicrets/ or to^other proprietary rights. 

' ■ ■ *' . . • 

99157. »ach test^ sponsor shall provide the following 

information to test subjects priot to the adminl^stration 

of a test I * . ' ' . . ^ . 

- (a) The purposes for whicl1%he test is coi>structed and 

i« intended to be used. ^^^s 

. (b^ The subject matters deluded on such test and the 

knoirliedge and skills which the test purports to measure. 

(c) The manner. in which the test ipjs^red and $:he 
reljitionship of the raw and scaled scores to the skills and- 
knpMledge it measures.^. * 

(d) "^he basis upon which such scpres will be made ^ 
available to pi^so/fs or institutions. 

(e) il^ representative set of stople test items. 

* \ 99158. Ip reporting test scores to test subjects^ the 
test sponsor shall .provide sufficient explanatory information 
to (acilitate^ proper interpretation of the score or scores. 
The information shall be distributed in the following * 
'manner: ' ? . - y 

(a) Teft subjects shall. )^e 'provided with %t^ements^ 
designed to provi^ {.nfoxanatipn for interpreting the . ^ 



sqores,, including, but not limitpd to^ explanations of i 

(1) The test score, scale. \ 

(2) The sco'^ds and their meanings^ ' 'J 

(3) Standard error of messurement of the test. ' * 

(b) Any postsecondary education iniititution or other^ 

, . ■ ^ \ •. . ■ . ' ■ ■ ■ ' ^ . 

organization which a test. s\ibjeci-^esignates as a test score 

recipient shall %e provided with all of the informati9n 

Specified in Section 99157 and in subdivision (a) of this* . 

/ ' - 

section. T!ie test sponsor shall provide such information 

* . • *' 

prior to or coincident with the first reporting of a test ^ 
score or scor|iS to a recipient* during^ s testing year. Such ^ 
i,nformation shall be* provided tb the commission prior to - 
6r coineident with the first reporting of test sCcOres to 
aify test score recipient during a testiftg y#ar. 

The test sponsor shall provide suq^ injformation o^e 
during, a testing year in a mannei; deemed suflficient to 
assure access to the information by ;^terested^ parties. 

99159r (a) In addition to^the informatioifai required 
pyursuant to -^subdivision (b) of Section 9915B|VviKe test/ 
sponsor shkll submit to the parties listed there in^liind to 
the cbimission the test sponsor^ s most recent national or 

■■ ' ■ • r / 

regional aggregation of data concerning the. preoictive 
validity oft 

(1) Academic record or grades alone. ^/ 

(2) Standi^d^L^ test sco^re alone . 
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'^,(t3)# Aead^ic teoora and tMt.scoxfe obiQbln|||* " rtl||^i;'' 
(b);i1ift :daVa shall be ;dl8«vii:nated pursuant to 'sul^r ^'if 
diviaipn (b) ; jd£ .Section 9915|vt«^^: / » . » ' 1 
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'99160. Any.taat 8pon«<}r iJKo inteniiorially>viol,atp8 any 
" provision df thif .chapter shalivbif lial^Xe ^or a^ civil, pehalty 
* notsto^ej^cyed sev^ j|i^ndred f ifty/dollatl <$750) for. each 
vioUt^iQh> ^ * " • . -m- ' \d/ 

/ ' wPPCi* 3.: ^Section 6254 of the Qpvei^nment Coda^ is amended^ 

^ Except M provided In Sipction 62^4»7.^ njJthing >n 

*■ ' . • • ^ v ^ • ^ ■ 

thiAchapter ehall be construed to require -disclisure of' ^ 
\^ • records that are: , ' . 

* (a) Preliminary drafts ^ notes ^ or interagency 

intra-agency memoranda whicj) are not ^retained b:^ the public ' 
agency in l^he qtdlnary course of business, provided that 
the' public interest In withholding such reqords clear If 
outweigh* the' public interest in disclesOrei ' * ^. 

tbf Retords pertaihin^to pending litigaj^ion to M^ich 
the publif agency is a party, -or to^laims made ijursuamt- V 
i^ivision 3.6 (cownencing with Section 810) of Title I v 

■ . ■ : ^ ■ ^ ' • . ^ V • 

Of the Ck>vernmeflt Code, until such litigation or^c^aim ^ 

...» ■■' . ' ^- ' ■ • * ' ' 

has-been. finally adjudicated or otherwise settled; • 

^ (c) • Personnels medicalr.or similar fij,es, the * . . 

* ' /' < • ^ ' * * » 

disclosure Of which would constitute ao unwarranted invasion-' 

of personal privacy; f . ^ 



" ' ^* (di^ontain^d in or relatet^ to: 

^ (1) Applications ^filed i(lth dby; state agenoy^responeibl^ 

fog^'km regulation oti supervision of thp' issiiancp of * ^. ^ ■ 
I .^Acuril^ies or of financial ins€it|Hon^,» incfludiivi, but not 

. . ;7N^ . . ^' ; ^^'^f '^'^ ^- ' X ■ • ; , ^ 

'Limitiid tOf "banks, saving*.^ and , loan* aseegiat ions, inidustjrlal * 
^oan companiee, cri^it unions, 'and'' insijirartce oosip|nies; v « ,1 ^| 

• • . ■■ V- ^4 • • ■ . * \; V . f 

— ♦ (7)^ Examination, , operatih^;^, or cqndition. re|KVt;8 ^ # ' 

^ prepared by, on behalf of, or for the use 0% any>state/ 

■■■ ^ • *- TV ^•^'^::.;/- 

egenc^ referred, to in^ subdivision^ (],) ; Jk 

• (3) Preliihinary draftis, ^no^es, or intera<fertc)^^ intra- * 
agenqy communications pr*epai:^d by*, on betjalf «0f , ot for tWrf 
use of aov' state agency referred to in subdivision (In; or 

(4) Ihfoematien recfiyed inS^onf idence by. any state 

. '• • ■ • n ' * ■ .* • . > 

■ 1.* ' - ' < ■ 

agency referred to in subdivision (1) « ^ g ' " 

(e) Geological and. geophysical data, plant production 
dat^a and^iiriilar information relating to utility aysts^f^ 

development, or ma'ricet or crop reports. Which are obtained 

f ' ■ ^ ' . ' ■ 

in confidence from any person;. ' ' ' ^ 

• , ( f ) Records #f cOmpLainti to o( . investigations 

conducted by, or records .of intelligence information or 

fecurity prbcedurei of r the office 'of the Attorney General 

and the 'Oepartmeet 0f- Justice r and any ^state or local 

po^^i^e agency, or an^i 



Such investigatory or security files 
compMed by any other state or local police agency # ot any 
suc6 investigatory or security files compiled by ai^r other 
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dutm, tiMd, wA location of tn« ii|cid«nt, a).l diagraaa, 

rz 



itiittt or lOMl. agency for ooir^aqtlOnal » Im VforcMant / 

' . . iL • . ^ . 

OK licraaliit piirpo^aa^r exbapt that looal poLica agano^^a 
ahall 41aol,oia. tha' naMiif*ai>d «Iddraaaaa of |>araQna involvad^ 
in, or wltnaaaaa othar thM confadantial infbnuMita t^V 
tha Inoid^iti^ tha daaoription of any proparty Involni^d, 4^a 

atat«aanta of tha partiaa* Involvad in tha inoidaritf tha 

•* , r • ' 

atatMMnta of all witnaaaaAf othar^than o6nfidantiaI^ 

■ / • • •» ■ 

J^foriMintaf to th^ "paraona involvad in fn indidantf or an 
aUthorlKad rapraaantativa tharaof^ an linauranoa oarriar 
agaliiat whloA a claim haa baan pr might ba mada, and any / 
paraon auf faring bodiiy injury 9^: proparty damaga aa t^a 
raault^of tha inoidant oauaad^^y araon, bucglary, fira, ^« 
axpIoaioAv robbary, vandaliam, or a orima of .vio^anoa aa 
4aflnad by aubdtviaion (b) of Saotion 13960, xinlaaa tha ! 
diaoIoaura^Wudl andangax^^tha aafaty of a wiinaaa or othar 
paraon involvad in thm in^gpatigatibn, diaploaura would 
andangar tha auooaaful oonq^a 
or a rala^ad invaatigation^ 



tion of tl\^ invaatigation 



i 



I (g) Taat quaationa, aooring kaya, and ^thar axamiAation 
data uaad to admlniatar, a.^Iioanaiiig axaminationr axMiinatiafi^ 
for a^ploymantr or aoadanio axaliination# axoapt aa providad 

for in Chapter 3 (doMninoing wiih Saotion 99150) of Part 65 

- r ' 

of tha Sduoation Coday 

«. ** . • . , 

(h) Tha oontanta of raal aatata appraiaala^ linginaar- 



• * > 



» . 
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ing or f«asibiliiy MtiMtM aiM evitluatlont 4ad« for or by 

/ . » ' , f*. : ' ■ ■ ^ ■ 

tha atata or local ifutncy ralativa tor tha acquisition of 

'•'.•* " . / \ ■ 1 ' * 

propartyv or to.proapactivA public aupply 'And' cons truct^ra 



oigintraqta^ 'until auch tima aa all of t^a property hVi 



a baan 



1 



/ 



I' 



acquirad or'^all^f tha contract agraapar 
fiowav^/ tha law^of amii^^^t do^a^*^ Shall not^ba affactad by 

^ . f ■ • «■ 
(i) Information* raq^i»rad ffom any taxpayar in connactibn 
with tha collaction of Idea/ €AiSca8 whidh^ia racaivad in 
oonf idanca 'tnd tha diacloaura pf thai information to othatf 

■ \ ' r 

paraoha would ^aault in unfair cdtopatitiva diaadvantaga « 
to tha paraon aupplying auoh- information; , 

(j)^Librjiry/and muaaum matariala^m^da or acquirad 
and praaantad/Mlaly for rafaranca or axhibltion purpoaaa; 

(k) naWda tha diacloaura of which ia axampttd or 
'pr(AiibitMi»''pur8uant to previa iona of fadaral or atata law, 



int obtaipad^' providad. 



thia proviaionr 



^ including, but/ not limitad to,, pro via iona of tha Bvidanca 

• -.i \ ' ' ' . 

^ Coda ralating to p^^lvilagai 

(I) Corralpondanca of and to tha OdVarnpr -or 
*' . *• 

amployaaa of tha Gtovarnor^a offica or in tha cuatody of 

' ' ■ ■ ■ . • V ^ 

or maintainad by tha Govarnpr^a, lagal affalra aacratary, 

proviobd public raoorda ahall not ba tranafarrad to tha 

cu8tod^9f tha (Jovamor^i lagal affaira aacratary to avada 

tha diadioauta proviaibna of thia ohaptarr si - 

(m) In thil cuatody or maintainad by tha Ba^ialativa 



♦ 



01 



(n) /ItatMMmta of ,p«rpon«l irorth p^rtoiui flnuiolal 
*d«t« Mqnir^d by « llo«nsln9 agmcy m4 flltd^by^an applldant 
with fuoh lloMislng agindy to iatdblteh hit paj^^^^ quail** 
eidatlon for thli^^lioanaV oartlfliattf^o paxmlt app^lad fori 

(o) Flnaiiolal data oontalnad in apflllGatlOM for / 
f inanoin? ^dar Diviaion 27 (ooManoing vlth'^Saotlpn 44S(^) «\ 
of th«^6aalth and lafaty Coday avthorisad" of #ioar\ 

of tha California Pollution Control Financing Authority . \ 
datariiinaa that dJ:aoloaur# of auoh financial, data ^uld ba 
coaq;>#titivaiy injurioua to tha applicant and auph dati ia 
raquirad in ordar to "obtain guarluitPaa f rcai tha Uhltad iStatai 

• ■ • ' r ■ > ■ 

taall luainaaa Adniniatration. 9ha California Pollution 

(iontrol Pinancing^ Authority ahall adopt rulaa for riviair 

of individual raquaata for oonl^idantiality u(idar thla^ 

iactidn i|Ad forrMking avallabla to tha public thoaa portiona 

of an application which ara.kubjact to diacloaura undar tkia 

chaptar.' : . . \ 

Nothing iii thib 'taction ia to Jt>a conatruad aa pravantin^ 
* • ' % ■ .... 

any aganoy froai opaning ita raoorda ooncaming tha 

adminiat^ation of tha agancy to public inapactiony unlaaa 

diacloaura ia otharwiia prohibltad by law. 

8BC. 4. Xt ia. tha intant of tha Lagialatura that tha 

inforaiation dlaclo«ii(ra raquiraMinta o»thla act ba ^ 



•ppllqabl* to th« •nt^r< 



•ntir* tilting ywur •niilng tn 19^9. 
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APPENDIX D v' 

STATE ilF.NEW YORk 



$. 5200-A ♦ A. 7668-A 

Cal< No. .1215 • : ' 

1979-1980' Regular Sessions 



9 . 



SENATE r ASSEMBLY 

April 26 » 1979 ' 



Hi SBNATE - Intfoduead by Seiis. LaVALLB, ACKBRMANr BABBUSH, 
ilAKTOSIBWICZ, BBATTY, BERMAN, 4EMISTBIN, BRUNO, CAQ^RBR, 
CONNOR, FI.tNN, CALIBER, GOODHUE, HALPERIN, tkCK, LEXCHTBR, 
HARKOIflTZ, McCALL, MfcGA, MB^DEZ , OWENS , PAOAVAN, PISANI, 
PRESENT, RUI Z , JOLOMON , TAURIBLLO , « TRUNZO^ VOLKBR, ^ 
WINXkoff - read twioa Md ' ordarad prln and whan printad 
to jla ooMittad to the ComliiittM on Education raportad 
fav6ral3»ly from said conmittaa ^ndSrlomnitttd to thin ' 
ConvAittaa pn Highitr Education - rapUrtad favorab^Ly ftom 
said coranfttaa, ordarad to fitat and iacpnd raport,' ordarad 
to a third raadingr amandad and ordarad raprintfd, ratAining 
^its plac* in. the order of third feading. 
IN JMSBNBLY - In^roAlce^ by COHMITTEB ON <RUI.ES - (at 



raquast^of M« of A« yann, LaFayatta, Bianchi, Boy land, 

Cochrana, Coopaman, Eva, Farrall, Flanagan, For tuna,' 

Giottfriad, Grannla, Qrlf fith,vHaranbarg, Hinchay, Hirach, 

Mochbruacl^nar', Howard, Jacobs, Jankina, Koppall, Lantol, . 

.Lewis, Lipachuti, McCaba, O.W* Millar, Nina, Passannanta, 

.Pasca, Proud, Sarranc aiagal, B.C. Sullivan, Virgilio, 

D.B« W&lsh, Yavo^i, lEagdna) raad onci and^ rafarxad to tha 

Committaa on High4r Educ^atiph - raportad and rafarrad to 

* ■ • . ' ■ ♦ . ■ * 
tha* Coantittaa on Ways and Maans ^ coapj^taa' dischargadlobill 

anandad, ordarad irapriptad as anandad and raconmittad to 
' said eoinmitt^p ^ * * * ^ 

* AN j^CT to amand tha education* law, in relation t6 
st;andardiaa&^ t«»tip9 . 'V ^ 

' i$lfim ^abpl^ of tha Stata of Naw York, raprasantad in 



S^nat/i and Asaamb^y, do anact as follows s 

Section 1* The ed ioatipn .law is amended by adding ;a 



nay articlji sevih^^A to read as follows t 
4 . APPICLE 7-rA» ^ 

' ' STAHDA!U)IZED TESTtNG 
Section 340. Definitionb. 

341. Background reports and statistical data« 
* 342. Disclosure of test contents; 
"^343. Notice. • 
.344. Diaolosure |of test scores^ 
34*5 • Regulations. 



4t 



346. VloUt4oM. / ^ 

, 347. S4v«rabiUty; V 
§340v DttflAitions. Km us#d in thia artiolttt 
1. "Standardised taat". or''"taat" Mans any*taat that is giVan 
at tha axpanaa of tha tast siibjaot an^ daaignad for uaa^or 
iifad in tha prooaaa of aplaotion for poat«*aacMyidary.or ^ 
prbfaaaional aohool aduiaaioni. Such taata ahall inoludar 
bu^ ara not liaiitad^'to, tha Prjj^liminaify Poholastio Aptitude. . 
Taatr Soholaatio Aptitude Test, ACT Aaaeaament, Graduate 
Record BxamiriatioA, Nadioal College Adiiiaai<m Teat, Law 
, 8oh6ol AdMiaaioa Teat, DeAtal, AdmiaaiOn Teating Program, 
Graduate Managenent ^daiaaion ^^'t, and Miller Analogiea Teat. 
Thia article ahall not apply to any a^te^ federal, or local 
^dv^l aerMce iteat,.(ny teat deajlgned and uaed^ solely for non- 

■ • - ^- y ■ . . 

edaiaaioh |>iacei»ent or credit-rby^examinatidn/ or any teat 
developed and adaiiniatered by an individual school or . 
inatit'ittion for ^ its own purpoaea oiuy. * 

2« **^BaA.aaione#" mana the coiraniaaioner of education 
of the rState of New York. ^ 

3. "teat subject" shall mean an individual to whom a 
teat is a(||glnister4^\ ^ ' 

4( "Tea/ agency** a^ll mean any organisatito, ' 
aaaociation, corp<^4^tioiiiV partnerahip, or individual or « 
peraon thats^^velopa , y^ponaora or adminiatera a teat* 



116 



I $ 341. Background reports and 'atatiatical data. ' 
\. v^enever any ^at agency prepares, causes to have prepared. 

^r provides the data which are used in any study, evaluation 
or statistical report pertaining to a test, such study, 
evaluation or report shall be filed with the connnissioner. 

2. If any « reports or other documents, submitted pursuant 

■ p • * 

to this eaction contains information identif iabll with any 
individual tjsst subjects such information shall be deleted 
or obliterated prior ^to Mjibmission. 

3. All data, reports or pther jlocumenti| submitted , * 
pursuant to , this^ section shall be pubUo records ; - 

9 342. Disclosure of test contents. 1. Within thirtj^ ^ 
days after the results^of any standai|^ised test ^ra released, 
the test agency shall file or cause to be filed in Che ' 
office of the commissloneri ' ^ 

■ . . f ■ ■'■ ■ . \ ■• . ■ . 

a. ^ copy of all test questions uSe4 in caO^culating the 
test subjejpt*s raw scorei 

b. the corresponding acceptable answer s* to *those 
ques tions I and ; ^ ^ / 

c. ^all rul«s for transferring rew scorei into thp#e \ 
scores reported to the ^est subject together with an. 
explanation of such rules. 

2. Aftei^ the test has been filed with the commissioneir, 
and upon the request of the test subject, the test agency 



shall smd to thm t«st sub j«qts . . 

a copy of tl^a tot quastions us«!d in dataniinlhcl the 
. subjact's raw aoorai 

. b« tha subjaot's individual aAawar shaat togatflar with, 
a copy of tha oorract anavar shaat to \hm sana taA; with 
quastions counting toward tha sqbjaot's raw soora so markad^ 

and - • t ' sj-^. . . . \ 

c* a stataMnt of tha raw acora uaad . oaloulata tha 
sooras ^iiraady sant to tha subjaot, provide* that such'' 
raquast has baan'Mdcf within, hlnaty days of ti|ia ralaasa of 
tha. tast stera to tha tast subjaot. ^ 

Tha agandy may -oharga a nominal faa for sanding out 
^^t}h ll^omation, not to axoaad tha diraot cost or*t>rovidiiig 
'^(!jiSf^nforiiation^« 

3 « This saction shall not apply to Collaga Qoard 
Achiavamant.Tasts or 6RE Advance Tasts* 

4 « Documanta subnittad 1^ tha cqnuiiiasiona& {Pursuant 
to this saction shall ba pti^lid racor4a. ^ * _ . & 

$343* Notica 1. Bach taf t agancy shai^ .iftrovlda», along ^ 
witl^ tha ragistratipn fortu for a taaki tha following * \ 
infonnationt ■ pc^ •■ . c "^^ ^-w. ^ # 

a* Tha purpoaas f Sr mioh tha tast ia cohatructa<l ^nd 
is intandfd to ba uaad. \ T 

' b. Tha subjact Mtiar^ |ncludadjbn such taat ^il^^Jj^ 



toowl4idga aiid skills which tha taft purports. ti» Masura« 

c« i^t«aants "dasigndt to i9#6vida jAfOmation for 

Tihtarpf Aing t^t rafuits, incli^iaig but not liidtad to, 
• % / S ^ * 

axpla^tiTons ^ ,4h<Wt soojri^ acala^ tha standard ar«or 

of iMiasufSMnt o^ tha tast, Md a liat of i^vai^abla ^ 

oorralatibns batwaan tast sooras and ^grad as, auccaaaful . r 

complat^n of a ooursa of study and patah^l iiicoaia* 

d« now tl}a taat sporas will: b4 rapprtad, whathacKtha • 

raw taat 'scoras will ba altara# in any way bffora baing 

r^por^ to tha tast subjact ^n^ whathar and how tha tast 

agan^ will usa i tha tast scora in raV or tranafomad for« 

by itsalf or togathar with any ot|iar information about tha 

^taat^subjact to pra4ict^ way tha subjact <s futura 

acadamlc,4P>frfonMmqa for ^liy pos^ sacond4ry aducational 

'"^^ a. A boaiplata dascrii^tlpn of any promisas or covananta 
that tha taat^agancy makaa to tha tast subjact with ragard , 
to accuracy of .scoringf^iMly forwarding of information^ 
polibias for notifying tast subjacts ragarding inacquracias 



in s9!^ing or icora raportihg and privacy of Information 
ra|atzng. to tha tast subjact* 

» #f. Whathar^or not taat aooras ara tha proparty of tha 
tmmt subjactr how long thay will ba ratainad by tha tast 
. agahcy/ and policias tagi^i^fling storaga^ disposal and 
futura uaa of tast soora data* ' x ' 

■ .; • ■■ ■ • " ■ 



2. Any institution which ^it • tot^soon i:«oipimt shall. 




lUgrovidad with ths infoirMition ^pMifisd in ^his ssotion. 
Ihs tist ^gmnof sh«lltprovid« such infoznation prior to 
or poinoidmt irith ths first reporting of • ^tsst scors or 
acorss to • rscipi«nt institution. Stteh Unstitution sha^l - 
b« snooura^ad to provids jji^rprftiys proosasing by 
.qualifiad parsonnsl whsrs such parsonQpl ara avafTable. ^ ^ 
, §344. Dla^fura of tast 4coras. Tha scora of any tast 

sobjaot^ahall hot ba ralaasad or disclosatl by tha tast 

. w • * ' ^ . ♦ . % 

agancy to anjP parson, organisjttion^yoorporation,^|isso9iation# 
« « colXaga, univarsity, pr govarniMintal agancy or subdivifion 

unlass specifically authoHiad by tha *tast«8ubjact. A 

4 . ' . 

taat agancy nay, howavar, ralaasa all pravious sooraa 

05 . ^ ■ . ' ■ 

to racaivad by- a tast ^sub jaot /on a tast to anyona dasignatad by 
t)^ tast aubjact to racaiva tha currant scora. ' ■ ^ 
* ,*!S|^^^*«W^t^^ shall ^ not li^ construad to prohibit ^ 
ralaasa of acoraa and othar inforaation' in tha poasasslon , 
of a tast agaifoy for purpoaas of raaaaroh laading to 
studias and raport# oonoaming tha tasts thamsalvas. Such 
stiidias and raports must cbnta^^noii^artetion idantif iabla 
^ ' with any individual' tast subja^. ^^"^^ 

"$345. Ragulatiohs. * Tha coMiisdrionar^^^itfRSll prcaiulgata 
^ ragulatio^s to iiQ>la9aii^^^a provisions of this artiola. 
1$ 346. ^Violations; Any t^st agancy which violatas any 
aactiot of thia artJ^cla shall t>a lUbla for a civil panalty 
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Of not libra; than fiva hundrad dollars for aach violatioh. 

- f 347. :S«««rability. if any provision of 1;his artlol. 
al)all ba' daclarad unconatitut^onal or invalid, tha othar 
proviaions shall ramain in af fact, notwithatimding. ^ 

5 2. Thia A^t ah&ll taka affact on tha firat day of 
grahuary naxt auqcaading tha data on which it ahall hava 
bacoaw a law. V ^ 





Tha kducation Commission of th« Stitas is a nonprofit 
'^organixation formad by intarstata compact id t966. Forty-savan 
statas, Amarican Sunoa. Fu«rto Rico and tha Virgin Islands ara 
jiQW mambars. its goat is to furthar a working raMtionship 
'among govaroorsi ttata lagislaltrs and ifducatort for .tha im- 
' Nproiamant of aducation.i This taport is an outooma of ona of 
many*^mmitsioin^undart*kingi at all lavals of aducation. Tha 
comipisiiofi offitiiii ara Jocatad jit |uita 300, I860,. Lincoln 
Stiaat.t)an||ar,tolorado 40296. 

• > It is tha poiiey ttl tha 4Edtt^ion Comrfiission of tha Staias to 
vik» afffrmativa action ^o prayant discrimination ia its poilcias, 
programs and amploymant jwactioai. ' ^ ^ 



